2023-02-11 19:53:30,080 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-02-11 19:53:30,378 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944 2023-02-11 19:53:30,392 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-02-11 19:53:30,392 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/cluster_675f2e08-3f55-fd57-3b4a-b26ff360a207, deleteOnExit=true 2023-02-11 19:53:30,392 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 19:53:30,393 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/test.cache.data in system properties and HBase conf 2023-02-11 19:53:30,393 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 19:53:30,394 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/hadoop.log.dir in system properties and HBase conf 2023-02-11 19:53:30,394 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 19:53:30,394 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 19:53:30,395 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 19:53:30,511 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-11 19:53:30,928 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 19:53:30,933 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 19:53:30,933 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 19:53:30,933 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 19:53:30,933 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 19:53:30,934 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 19:53:30,934 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 19:53:30,934 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 19:53:30,935 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 19:53:30,935 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 19:53:30,936 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/nfs.dump.dir in system properties and HBase conf 2023-02-11 19:53:30,936 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/java.io.tmpdir in system properties and HBase conf 2023-02-11 19:53:30,936 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 19:53:30,937 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 19:53:30,937 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 19:53:31,486 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 19:53:31,492 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 19:53:31,780 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-11 19:53:31,956 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-11 19:53:31,977 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 19:53:32,026 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 19:53:32,059 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/java.io.tmpdir/Jetty_localhost_44391_hdfs____.o6768b/webapp 2023-02-11 19:53:32,218 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44391 2023-02-11 19:53:32,257 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 19:53:32,257 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 19:53:32,744 WARN [Listener at localhost/43109] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 19:53:32,855 WARN [Listener at localhost/43109] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 19:53:32,873 WARN [Listener at localhost/43109] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 19:53:32,880 INFO [Listener at localhost/43109] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 19:53:32,884 INFO [Listener at localhost/43109] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/java.io.tmpdir/Jetty_localhost_45827_datanode____.mdbh6l/webapp 2023-02-11 19:53:32,979 INFO [Listener at localhost/43109] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45827 2023-02-11 19:53:33,274 WARN [Listener at localhost/32929] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 19:53:33,715 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd9663af49076392a: Processing first storage report for DS-3490ae13-2780-49d7-9d92-4a83992f75bb from datanode 1cd277b8-e4bb-44b5-88a6-20ef0ad23880 2023-02-11 19:53:33,716 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd9663af49076392a: from storage DS-3490ae13-2780-49d7-9d92-4a83992f75bb node DatanodeRegistration(127.0.0.1:40807, datanodeUuid=1cd277b8-e4bb-44b5-88a6-20ef0ad23880, infoPort=38579, infoSecurePort=0, ipcPort=32929, storageInfo=lv=-57;cid=testClusterID;nsid=407148281;c=1676145211569), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-11 19:53:33,716 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd9663af49076392a: Processing first storage report for DS-d0e16ee0-1d86-4447-b543-187ecbbbb430 from datanode 1cd277b8-e4bb-44b5-88a6-20ef0ad23880 2023-02-11 19:53:33,717 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd9663af49076392a: from storage DS-d0e16ee0-1d86-4447-b543-187ecbbbb430 node DatanodeRegistration(127.0.0.1:40807, datanodeUuid=1cd277b8-e4bb-44b5-88a6-20ef0ad23880, infoPort=38579, infoSecurePort=0, ipcPort=32929, storageInfo=lv=-57;cid=testClusterID;nsid=407148281;c=1676145211569), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:53:33,774 DEBUG [Listener at localhost/32929] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944 2023-02-11 19:53:33,833 INFO [Listener at localhost/32929] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/cluster_675f2e08-3f55-fd57-3b4a-b26ff360a207/zookeeper_0, clientPort=64025, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/cluster_675f2e08-3f55-fd57-3b4a-b26ff360a207/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/cluster_675f2e08-3f55-fd57-3b4a-b26ff360a207/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 19:53:33,847 INFO [Listener at localhost/32929] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64025 2023-02-11 19:53:33,856 INFO [Listener at localhost/32929] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:53:33,858 INFO [Listener at localhost/32929] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:53:34,497 INFO [Listener at localhost/32929] util.FSUtils(479): Created version file at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da with version=8 2023-02-11 19:53:34,497 INFO [Listener at localhost/32929] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/hbase-staging 2023-02-11 19:53:34,789 INFO [Listener at localhost/32929] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-11 19:53:35,236 INFO [Listener at localhost/32929] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-02-11 19:53:35,266 INFO [Listener at localhost/32929] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:53:35,267 INFO [Listener at localhost/32929] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 19:53:35,267 INFO [Listener at localhost/32929] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 19:53:35,267 INFO [Listener at localhost/32929] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:53:35,267 INFO [Listener at localhost/32929] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 19:53:35,404 INFO [Listener at localhost/32929] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 19:53:35,477 DEBUG [Listener at localhost/32929] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-11 19:53:35,568 INFO [Listener at localhost/32929] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40445 2023-02-11 19:53:35,578 INFO [Listener at localhost/32929] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:53:35,580 INFO [Listener at localhost/32929] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:53:35,600 INFO [Listener at localhost/32929] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40445 connecting to ZooKeeper ensemble=127.0.0.1:64025 2023-02-11 19:53:35,637 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:404450x0, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 19:53:35,640 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40445-0x10044f22b400000 connected 2023-02-11 19:53:35,663 DEBUG [Listener at localhost/32929] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:53:35,664 DEBUG [Listener at localhost/32929] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:53:35,667 DEBUG [Listener at localhost/32929] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 19:53:35,674 DEBUG [Listener at localhost/32929] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40445 2023-02-11 19:53:35,674 DEBUG [Listener at localhost/32929] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40445 2023-02-11 19:53:35,675 DEBUG [Listener at localhost/32929] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40445 2023-02-11 19:53:35,675 DEBUG [Listener at localhost/32929] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40445 2023-02-11 19:53:35,675 DEBUG [Listener at localhost/32929] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40445 2023-02-11 19:53:35,681 INFO [Listener at localhost/32929] master.HMaster(439): hbase.rootdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da, hbase.cluster.distributed=false 2023-02-11 19:53:35,747 INFO [Listener at localhost/32929] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-02-11 19:53:35,748 INFO [Listener at localhost/32929] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:53:35,748 INFO [Listener at localhost/32929] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 19:53:35,748 INFO [Listener at localhost/32929] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 19:53:35,748 INFO [Listener at localhost/32929] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:53:35,748 INFO [Listener at localhost/32929] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 19:53:35,753 INFO [Listener at localhost/32929] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 19:53:35,755 INFO [Listener at localhost/32929] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45897 2023-02-11 19:53:35,757 INFO [Listener at localhost/32929] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 19:53:35,763 DEBUG [Listener at localhost/32929] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:53:35,764 INFO [Listener at localhost/32929] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:53:35,767 INFO [Listener at localhost/32929] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:53:35,768 INFO [Listener at localhost/32929] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45897 connecting to ZooKeeper ensemble=127.0.0.1:64025 2023-02-11 19:53:35,772 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:458970x0, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 19:53:35,773 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45897-0x10044f22b400001 connected 2023-02-11 19:53:35,773 DEBUG [Listener at localhost/32929] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:53:35,774 DEBUG [Listener at localhost/32929] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:53:35,775 DEBUG [Listener at localhost/32929] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 19:53:35,776 DEBUG [Listener at localhost/32929] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45897 2023-02-11 19:53:35,776 DEBUG [Listener at localhost/32929] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45897 2023-02-11 19:53:35,777 DEBUG [Listener at localhost/32929] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45897 2023-02-11 19:53:35,777 DEBUG [Listener at localhost/32929] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45897 2023-02-11 19:53:35,778 DEBUG [Listener at localhost/32929] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45897 2023-02-11 19:53:35,779 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40445,1676145214633 2023-02-11 19:53:35,788 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 19:53:35,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40445,1676145214633 2023-02-11 19:53:35,808 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 19:53:35,808 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 19:53:35,808 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:53:35,809 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 19:53:35,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40445,1676145214633 from backup master directory 2023-02-11 19:53:35,810 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 19:53:35,813 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40445,1676145214633 2023-02-11 19:53:35,814 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 19:53:35,814 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 19:53:35,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,40445,1676145214633 2023-02-11 19:53:35,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-11 19:53:35,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-11 19:53:35,896 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/hbase.id with ID: cd874a10-232e-43a5-a43e-2e900eda296f 2023-02-11 19:53:35,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:53:35,951 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:53:35,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x79b13808 to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:53:36,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@227a3a71, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:53:36,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 19:53:36,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 19:53:36,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-11 19:53:36,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-11 19:53:36,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-11 19:53:36,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-11 19:53:36,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:53:36,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/MasterData/data/master/store-tmp 2023-02-11 19:53:36,525 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:53:36,526 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 19:53:36,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:53:36,526 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:53:36,526 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 19:53:36,526 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:53:36,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:53:36,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676145216525Disabling compacts and flushes for region at 1676145216526 (+1 ms)Disabling writes for close at 1676145216526Writing region close event to WAL at 1676145216526Closed at 1676145216526 2023-02-11 19:53:36,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/MasterData/WALs/jenkins-hbase4.apache.org,40445,1676145214633 2023-02-11 19:53:36,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40445%2C1676145214633, suffix=, logDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/MasterData/WALs/jenkins-hbase4.apache.org,40445,1676145214633, archiveDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/MasterData/oldWALs, maxLogs=10 2023-02-11 19:53:36,598 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40807,DS-3490ae13-2780-49d7-9d92-4a83992f75bb,DISK] 2023-02-11 19:53:36,605 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-11 19:53:36,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/MasterData/WALs/jenkins-hbase4.apache.org,40445,1676145214633/jenkins-hbase4.apache.org%2C40445%2C1676145214633.1676145216558 2023-02-11 19:53:36,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40807,DS-3490ae13-2780-49d7-9d92-4a83992f75bb,DISK]] 2023-02-11 19:53:36,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:53:36,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:53:36,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:53:36,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:53:36,726 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:53:36,733 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 19:53:36,756 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 19:53:36,767 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:53:36,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:53:36,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:53:36,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:53:36,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:53:36,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60781333, jitterRate=-0.09428755939006805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:53:36,794 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676145216697Initializing all the Stores at 1676145216699 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676145216700 (+1 ms)Cleaning up temporary data from old regions at 1676145216781 (+81 ms)Cleaning up detritus from prior splits at 1676145216781Region opened successfully at 1676145216794 (+13 ms) 2023-02-11 19:53:36,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 19:53:36,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 19:53:36,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 19:53:36,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 19:53:36,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-11 19:53:36,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 30 msec 2023-02-11 19:53:36,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 19:53:36,873 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 19:53:36,878 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 19:53:36,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 19:53:36,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 19:53:36,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 19:53:36,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 19:53:36,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 19:53:36,918 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:53:36,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 19:53:36,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 19:53:36,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 19:53:36,935 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 19:53:36,935 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 19:53:36,935 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:53:36,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,40445,1676145214633, sessionid=0x10044f22b400000, setting cluster-up flag (Was=false) 2023-02-11 19:53:36,950 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:53:36,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 19:53:36,958 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40445,1676145214633 2023-02-11 19:53:36,962 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:53:36,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 19:53:36,969 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40445,1676145214633 2023-02-11 19:53:36,972 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.hbase-snapshot/.tmp 2023-02-11 19:53:36,982 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(952): ClusterId : cd874a10-232e-43a5-a43e-2e900eda296f 2023-02-11 19:53:36,986 DEBUG [RS:0;jenkins-hbase4:45897] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 19:53:36,992 DEBUG [RS:0;jenkins-hbase4:45897] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 19:53:36,992 DEBUG [RS:0;jenkins-hbase4:45897] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 19:53:36,995 DEBUG [RS:0;jenkins-hbase4:45897] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 19:53:36,995 DEBUG [RS:0;jenkins-hbase4:45897] zookeeper.ReadOnlyZKClient(139): Connect 0x57cb832b to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:53:37,002 DEBUG [RS:0;jenkins-hbase4:45897] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@590c67a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:53:37,002 DEBUG [RS:0;jenkins-hbase4:45897] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d33e85b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 19:53:37,025 DEBUG [RS:0;jenkins-hbase4:45897] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45897 2023-02-11 19:53:37,029 INFO [RS:0;jenkins-hbase4:45897] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 19:53:37,029 INFO [RS:0;jenkins-hbase4:45897] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 19:53:37,029 DEBUG [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 19:53:37,032 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40445,1676145214633 with isa=jenkins-hbase4.apache.org/172.31.14.131:45897, startcode=1676145215747 2023-02-11 19:53:37,047 DEBUG [RS:0;jenkins-hbase4:45897] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 19:53:37,088 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 19:53:37,096 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46971, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 19:53:37,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:53:37,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:53:37,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:53:37,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:53:37,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-11 19:53:37,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:53:37,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 19:53:37,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:53:37,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676145247099 2023-02-11 19:53:37,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 19:53:37,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2815) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 19:53:37,106 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 19:53:37,107 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 19:53:37,112 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 19:53:37,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 19:53:37,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 19:53:37,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 19:53:37,126 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 19:53:37,126 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 19:53:37,126 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 19:53:37,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 19:53:37,130 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 19:53:37,130 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 19:53:37,132 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 19:53:37,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 19:53:37,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676145217135,5,FailOnTimeoutGroup] 2023-02-11 19:53:37,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676145217135,5,FailOnTimeoutGroup] 2023-02-11 19:53:37,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 19:53:37,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 19:53:37,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 19:53:37,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 19:53:37,142 DEBUG [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(2829): Master is not running yet 2023-02-11 19:53:37,143 WARN [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 100 ms and then retrying. 2023-02-11 19:53:37,244 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40445,1676145214633 with isa=jenkins-hbase4.apache.org/172.31.14.131:45897, startcode=1676145215747 2023-02-11 19:53:37,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:37,255 DEBUG [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da 2023-02-11 19:53:37,255 DEBUG [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43109 2023-02-11 19:53:37,255 DEBUG [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 19:53:37,260 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:53:37,261 DEBUG [RS:0;jenkins-hbase4:45897] zookeeper.ZKUtil(162): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:37,261 WARN [RS:0;jenkins-hbase4:45897] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 19:53:37,261 INFO [RS:0;jenkins-hbase4:45897] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:53:37,262 DEBUG [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/WALs/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:37,262 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45897,1676145215747] 2023-02-11 19:53:37,270 DEBUG [RS:0;jenkins-hbase4:45897] zookeeper.ZKUtil(162): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:37,280 DEBUG [RS:0;jenkins-hbase4:45897] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 19:53:37,288 INFO [RS:0;jenkins-hbase4:45897] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 19:53:37,306 INFO [RS:0;jenkins-hbase4:45897] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 19:53:37,310 INFO [RS:0;jenkins-hbase4:45897] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:53:37,310 INFO [RS:0;jenkins-hbase4:45897] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:53:37,311 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 19:53:37,317 INFO [RS:0;jenkins-hbase4:45897] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-02-11 19:53:37,317 DEBUG [RS:0;jenkins-hbase4:45897] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:53:37,318 DEBUG [RS:0;jenkins-hbase4:45897] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:53:37,318 DEBUG [RS:0;jenkins-hbase4:45897] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:53:37,318 DEBUG [RS:0;jenkins-hbase4:45897] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:53:37,318 DEBUG [RS:0;jenkins-hbase4:45897] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:53:37,318 DEBUG [RS:0;jenkins-hbase4:45897] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 19:53:37,318 DEBUG [RS:0;jenkins-hbase4:45897] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:53:37,319 DEBUG [RS:0;jenkins-hbase4:45897] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:53:37,319 DEBUG [RS:0;jenkins-hbase4:45897] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:53:37,319 DEBUG [RS:0;jenkins-hbase4:45897] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:53:37,320 INFO [RS:0;jenkins-hbase4:45897] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:53:37,320 INFO [RS:0;jenkins-hbase4:45897] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:53:37,320 INFO [RS:0;jenkins-hbase4:45897] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 19:53:37,336 INFO [RS:0;jenkins-hbase4:45897] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 19:53:37,339 INFO [RS:0;jenkins-hbase4:45897] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45897,1676145215747-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:53:37,355 INFO [RS:0;jenkins-hbase4:45897] regionserver.Replication(203): jenkins-hbase4.apache.org,45897,1676145215747 started 2023-02-11 19:53:37,355 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45897,1676145215747, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45897, sessionid=0x10044f22b400001 2023-02-11 19:53:37,355 DEBUG [RS:0;jenkins-hbase4:45897] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 19:53:37,355 DEBUG [RS:0;jenkins-hbase4:45897] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:37,355 DEBUG [RS:0;jenkins-hbase4:45897] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45897,1676145215747' 2023-02-11 19:53:37,355 DEBUG [RS:0;jenkins-hbase4:45897] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:37,356 DEBUG [RS:0;jenkins-hbase4:45897] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:37,357 DEBUG [RS:0;jenkins-hbase4:45897] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 19:53:37,357 DEBUG [RS:0;jenkins-hbase4:45897] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 19:53:37,357 DEBUG [RS:0;jenkins-hbase4:45897] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:37,357 DEBUG [RS:0;jenkins-hbase4:45897] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45897,1676145215747' 2023-02-11 19:53:37,357 DEBUG [RS:0;jenkins-hbase4:45897] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:53:37,357 DEBUG [RS:0;jenkins-hbase4:45897] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:53:37,358 DEBUG [RS:0;jenkins-hbase4:45897] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 19:53:37,358 INFO [RS:0;jenkins-hbase4:45897] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 19:53:37,358 INFO [RS:0;jenkins-hbase4:45897] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 19:53:37,468 INFO [RS:0;jenkins-hbase4:45897] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45897%2C1676145215747, suffix=, logDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/WALs/jenkins-hbase4.apache.org,45897,1676145215747, archiveDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/oldWALs, maxLogs=32 2023-02-11 19:53:37,486 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40807,DS-3490ae13-2780-49d7-9d92-4a83992f75bb,DISK] 2023-02-11 19:53:37,490 INFO [RS:0;jenkins-hbase4:45897] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/WALs/jenkins-hbase4.apache.org,45897,1676145215747/jenkins-hbase4.apache.org%2C45897%2C1676145215747.1676145217471 2023-02-11 19:53:37,490 DEBUG [RS:0;jenkins-hbase4:45897] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40807,DS-3490ae13-2780-49d7-9d92-4a83992f75bb,DISK]] 2023-02-11 19:53:37,546 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 19:53:37,547 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 19:53:37,547 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da 2023-02-11 19:53:37,961 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:53:37,963 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 19:53:37,966 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740/info 2023-02-11 19:53:37,967 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 19:53:37,968 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:53:37,968 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 19:53:37,970 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:53:37,971 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 19:53:37,972 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:53:37,972 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 19:53:37,974 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740/table 2023-02-11 19:53:37,974 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 19:53:37,975 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:53:37,977 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740 2023-02-11 19:53:37,977 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740 2023-02-11 19:53:37,981 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 19:53:37,983 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 19:53:37,987 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:53:37,988 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71638063, jitterRate=0.06749032437801361}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 19:53:37,988 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676145217961Initializing all the Stores at 1676145217962 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676145217962Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676145217963 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676145217963Cleaning up temporary data from old regions at 1676145217979 (+16 ms)Cleaning up detritus from prior splits at 1676145217980 (+1 ms)Region opened successfully at 1676145217988 (+8 ms) 2023-02-11 19:53:37,988 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 19:53:37,988 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 19:53:37,988 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 19:53:37,988 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 19:53:37,988 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 19:53:37,989 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 19:53:37,989 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676145217988Disabling compacts and flushes for region at 1676145217988Disabling writes for close at 1676145217988Writing region close event to WAL at 1676145217989 (+1 ms)Closed at 1676145217989 2023-02-11 19:53:37,994 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 19:53:37,995 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 19:53:38,002 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 19:53:38,014 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 19:53:38,016 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 19:53:38,169 DEBUG [jenkins-hbase4:40445] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-02-11 19:53:38,172 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45897,1676145215747, state=OPENING 2023-02-11 19:53:38,179 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 19:53:38,180 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:53:38,181 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 19:53:38,183 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:53:38,365 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:38,367 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 19:53:38,370 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48382, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 19:53:38,381 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 19:53:38,381 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:53:38,385 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45897%2C1676145215747.meta, suffix=.meta, logDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/WALs/jenkins-hbase4.apache.org,45897,1676145215747, archiveDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/oldWALs, maxLogs=32 2023-02-11 19:53:38,401 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40807,DS-3490ae13-2780-49d7-9d92-4a83992f75bb,DISK] 2023-02-11 19:53:38,405 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/WALs/jenkins-hbase4.apache.org,45897,1676145215747/jenkins-hbase4.apache.org%2C45897%2C1676145215747.meta.1676145218386.meta 2023-02-11 19:53:38,405 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40807,DS-3490ae13-2780-49d7-9d92-4a83992f75bb,DISK]] 2023-02-11 19:53:38,405 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:53:38,407 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 19:53:38,423 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 19:53:38,428 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 19:53:38,433 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 19:53:38,434 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:53:38,434 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 19:53:38,434 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 19:53:38,436 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 19:53:38,438 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740/info 2023-02-11 19:53:38,438 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740/info 2023-02-11 19:53:38,439 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 19:53:38,440 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:53:38,440 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 19:53:38,441 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:53:38,441 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:53:38,442 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 19:53:38,443 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:53:38,443 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 19:53:38,444 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740/table 2023-02-11 19:53:38,444 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740/table 2023-02-11 19:53:38,445 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 19:53:38,445 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:53:38,447 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740 2023-02-11 19:53:38,449 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740 2023-02-11 19:53:38,453 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 19:53:38,455 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 19:53:38,456 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64961204, jitterRate=-0.03200262784957886}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 19:53:38,457 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676145218434Writing region info on filesystem at 1676145218434Initializing all the Stores at 1676145218436 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676145218436Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676145218436Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676145218436Cleaning up temporary data from old regions at 1676145218451 (+15 ms)Cleaning up detritus from prior splits at 1676145218452 (+1 ms)Running coprocessor post-open hooks at 1676145218457 (+5 ms)Region opened successfully at 1676145218457 2023-02-11 19:53:38,466 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676145218357 2023-02-11 19:53:38,481 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 19:53:38,482 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 19:53:38,482 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45897,1676145215747, state=OPEN 2023-02-11 19:53:38,485 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 19:53:38,485 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 19:53:38,489 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 19:53:38,489 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45897,1676145215747 in 302 msec 2023-02-11 19:53:38,493 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 19:53:38,493 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 488 msec 2023-02-11 19:53:38,498 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.4730 sec 2023-02-11 19:53:38,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676145215804, completionTime=-1 2023-02-11 19:53:38,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-02-11 19:53:38,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 19:53:38,559 DEBUG [hconnection-0x2fba5a70-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:53:38,562 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48394, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:53:38,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=1 2023-02-11 19:53:38,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676145278581 2023-02-11 19:53:38,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676145338581 2023-02-11 19:53:38,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 82 msec 2023-02-11 19:53:38,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40445,1676145214633-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:53:38,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40445,1676145214633-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:53:38,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40445,1676145214633-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:53:38,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40445, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:53:38,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 19:53:38,611 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 19:53:38,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 19:53:38,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 19:53:38,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 19:53:38,632 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:53:38,634 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:53:38,656 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/hbase/namespace/e850bceb7d66bdd1c5950a043e7e6c3e 2023-02-11 19:53:38,658 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/hbase/namespace/e850bceb7d66bdd1c5950a043e7e6c3e empty. 2023-02-11 19:53:38,659 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/hbase/namespace/e850bceb7d66bdd1c5950a043e7e6c3e 2023-02-11 19:53:38,659 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 19:53:39,079 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 19:53:39,082 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => e850bceb7d66bdd1c5950a043e7e6c3e, NAME => 'hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp 2023-02-11 19:53:39,495 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:53:39,495 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing e850bceb7d66bdd1c5950a043e7e6c3e, disabling compactions & flushes 2023-02-11 19:53:39,495 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e. 2023-02-11 19:53:39,495 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e. 2023-02-11 19:53:39,495 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e. after waiting 0 ms 2023-02-11 19:53:39,495 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e. 2023-02-11 19:53:39,495 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e. 2023-02-11 19:53:39,495 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for e850bceb7d66bdd1c5950a043e7e6c3e: Waiting for close lock at 1676145219495Disabling compacts and flushes for region at 1676145219495Disabling writes for close at 1676145219495Writing region close event to WAL at 1676145219495Closed at 1676145219495 2023-02-11 19:53:39,500 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:53:39,516 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676145219503"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145219503"}]},"ts":"1676145219503"} 2023-02-11 19:53:39,543 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 19:53:39,545 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:53:39,549 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145219545"}]},"ts":"1676145219545"} 2023-02-11 19:53:39,555 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 19:53:39,565 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e850bceb7d66bdd1c5950a043e7e6c3e, ASSIGN}] 2023-02-11 19:53:39,568 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e850bceb7d66bdd1c5950a043e7e6c3e, ASSIGN 2023-02-11 19:53:39,570 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e850bceb7d66bdd1c5950a043e7e6c3e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=false 2023-02-11 19:53:39,721 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e850bceb7d66bdd1c5950a043e7e6c3e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:39,721 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676145219720"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145219720"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145219720"}]},"ts":"1676145219720"} 2023-02-11 19:53:39,725 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e850bceb7d66bdd1c5950a043e7e6c3e, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:53:39,885 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e. 2023-02-11 19:53:39,886 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e850bceb7d66bdd1c5950a043e7e6c3e, NAME => 'hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:53:39,887 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e850bceb7d66bdd1c5950a043e7e6c3e 2023-02-11 19:53:39,887 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:53:39,887 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e850bceb7d66bdd1c5950a043e7e6c3e 2023-02-11 19:53:39,887 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e850bceb7d66bdd1c5950a043e7e6c3e 2023-02-11 19:53:39,890 INFO [StoreOpener-e850bceb7d66bdd1c5950a043e7e6c3e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e850bceb7d66bdd1c5950a043e7e6c3e 2023-02-11 19:53:39,892 DEBUG [StoreOpener-e850bceb7d66bdd1c5950a043e7e6c3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/namespace/e850bceb7d66bdd1c5950a043e7e6c3e/info 2023-02-11 19:53:39,892 DEBUG [StoreOpener-e850bceb7d66bdd1c5950a043e7e6c3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/namespace/e850bceb7d66bdd1c5950a043e7e6c3e/info 2023-02-11 19:53:39,892 INFO [StoreOpener-e850bceb7d66bdd1c5950a043e7e6c3e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e850bceb7d66bdd1c5950a043e7e6c3e columnFamilyName info 2023-02-11 19:53:39,893 INFO [StoreOpener-e850bceb7d66bdd1c5950a043e7e6c3e-1] regionserver.HStore(310): Store=e850bceb7d66bdd1c5950a043e7e6c3e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:53:39,895 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/namespace/e850bceb7d66bdd1c5950a043e7e6c3e 2023-02-11 19:53:39,896 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/namespace/e850bceb7d66bdd1c5950a043e7e6c3e 2023-02-11 19:53:39,901 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e850bceb7d66bdd1c5950a043e7e6c3e 2023-02-11 19:53:39,905 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/namespace/e850bceb7d66bdd1c5950a043e7e6c3e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:53:39,906 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e850bceb7d66bdd1c5950a043e7e6c3e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61820777, jitterRate=-0.07879863679409027}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:53:39,906 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e850bceb7d66bdd1c5950a043e7e6c3e: Running coprocessor pre-open hook at 1676145219888Writing region info on filesystem at 1676145219888Initializing all the Stores at 1676145219889 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676145219889Cleaning up temporary data from old regions at 1676145219897 (+8 ms)Cleaning up detritus from prior splits at 1676145219897Running coprocessor post-open hooks at 1676145219906 (+9 ms)Region opened successfully at 1676145219906 2023-02-11 19:53:39,908 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e., pid=6, masterSystemTime=1676145219878 2023-02-11 19:53:39,912 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e. 2023-02-11 19:53:39,912 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e. 2023-02-11 19:53:39,913 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e850bceb7d66bdd1c5950a043e7e6c3e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:39,914 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676145219913"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145219913"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145219913"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145219913"}]},"ts":"1676145219913"} 2023-02-11 19:53:39,921 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 19:53:39,921 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e850bceb7d66bdd1c5950a043e7e6c3e, server=jenkins-hbase4.apache.org,45897,1676145215747 in 193 msec 2023-02-11 19:53:39,924 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 19:53:39,925 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e850bceb7d66bdd1c5950a043e7e6c3e, ASSIGN in 356 msec 2023-02-11 19:53:39,926 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:53:39,926 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145219926"}]},"ts":"1676145219926"} 2023-02-11 19:53:39,929 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 19:53:39,932 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:53:39,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 19:53:39,934 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:53:39,934 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:53:39,935 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.3110 sec 2023-02-11 19:53:39,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 19:53:39,984 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:53:39,990 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 29 msec 2023-02-11 19:53:40,001 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 19:53:40,012 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:53:40,017 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2023-02-11 19:53:40,028 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 19:53:40,030 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 19:53:40,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 4.216sec 2023-02-11 19:53:40,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 19:53:40,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 19:53:40,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 19:53:40,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40445,1676145214633-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 19:53:40,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40445,1676145214633-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 19:53:40,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 19:53:40,088 DEBUG [Listener at localhost/32929] zookeeper.ReadOnlyZKClient(139): Connect 0x0629018b to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:53:40,093 DEBUG [Listener at localhost/32929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c1e7f16, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:53:40,107 DEBUG [hconnection-0x77bc4ff1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:53:40,118 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48398, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:53:40,128 INFO [Listener at localhost/32929] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40445,1676145214633 2023-02-11 19:53:40,129 DEBUG [Listener at localhost/32929] zookeeper.ReadOnlyZKClient(139): Connect 0x7defec53 to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:53:40,134 DEBUG [Listener at localhost/32929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64b944ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:53:40,134 INFO [Listener at localhost/32929] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:53:40,158 INFO [Listener at localhost/32929] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=211, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=385, ProcessCount=168, AvailableMemoryMB=4524 2023-02-11 19:53:40,168 DEBUG [Listener at localhost/32929] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:53:40,172 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42946, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:53:40,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-11 19:53:40,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:40,188 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:53:40,190 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:53:40,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-02-11 19:53:40,193 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c 2023-02-11 19:53:40,194 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c empty. 2023-02-11 19:53:40,196 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c 2023-02-11 19:53:40,196 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-02-11 19:53:40,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-11 19:53:40,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-11 19:53:40,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-11 19:53:40,613 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-11 19:53:40,615 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7671): creating {ENCODED => d52518349916d0cbd7809e18f5082b6c, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp 2023-02-11 19:53:40,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-11 19:53:41,028 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:53:41,028 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1603): Closing d52518349916d0cbd7809e18f5082b6c, disabling compactions & flushes 2023-02-11 19:53:41,028 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:41,028 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:41,029 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. after waiting 0 ms 2023-02-11 19:53:41,029 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:41,029 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:41,029 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1557): Region close journal for d52518349916d0cbd7809e18f5082b6c: Waiting for close lock at 1676145221028Disabling compacts and flushes for region at 1676145221028Disabling writes for close at 1676145221029 (+1 ms)Writing region close event to WAL at 1676145221029Closed at 1676145221029 2023-02-11 19:53:41,034 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:53:41,035 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676145221035"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145221035"}]},"ts":"1676145221035"} 2023-02-11 19:53:41,038 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 19:53:41,040 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:53:41,041 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145221040"}]},"ts":"1676145221040"} 2023-02-11 19:53:41,043 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-02-11 19:53:41,047 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=d52518349916d0cbd7809e18f5082b6c, ASSIGN}] 2023-02-11 19:53:41,050 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=d52518349916d0cbd7809e18f5082b6c, ASSIGN 2023-02-11 19:53:41,052 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=d52518349916d0cbd7809e18f5082b6c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=false 2023-02-11 19:53:41,203 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d52518349916d0cbd7809e18f5082b6c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:41,203 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676145221203"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145221203"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145221203"}]},"ts":"1676145221203"} 2023-02-11 19:53:41,207 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure d52518349916d0cbd7809e18f5082b6c, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:53:41,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-11 19:53:41,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:41,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d52518349916d0cbd7809e18f5082b6c, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:53:41,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly d52518349916d0cbd7809e18f5082b6c 2023-02-11 19:53:41,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:53:41,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d52518349916d0cbd7809e18f5082b6c 2023-02-11 19:53:41,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d52518349916d0cbd7809e18f5082b6c 2023-02-11 19:53:41,371 INFO [StoreOpener-d52518349916d0cbd7809e18f5082b6c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d52518349916d0cbd7809e18f5082b6c 2023-02-11 19:53:41,373 DEBUG [StoreOpener-d52518349916d0cbd7809e18f5082b6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1 2023-02-11 19:53:41,373 DEBUG [StoreOpener-d52518349916d0cbd7809e18f5082b6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1 2023-02-11 19:53:41,377 INFO [StoreOpener-d52518349916d0cbd7809e18f5082b6c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d52518349916d0cbd7809e18f5082b6c columnFamilyName family1 2023-02-11 19:53:41,382 INFO [StoreOpener-d52518349916d0cbd7809e18f5082b6c-1] regionserver.HStore(310): Store=d52518349916d0cbd7809e18f5082b6c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:53:41,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c 2023-02-11 19:53:41,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c 2023-02-11 19:53:41,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d52518349916d0cbd7809e18f5082b6c 2023-02-11 19:53:41,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:53:41,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d52518349916d0cbd7809e18f5082b6c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71821586, jitterRate=0.07022503018379211}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:53:41,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d52518349916d0cbd7809e18f5082b6c: Running coprocessor pre-open hook at 1676145221368Writing region info on filesystem at 1676145221368Initializing all the Stores at 1676145221369 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676145221369Cleaning up temporary data from old regions at 1676145221387 (+18 ms)Cleaning up detritus from prior splits at 1676145221388 (+1 ms)Running coprocessor post-open hooks at 1676145221398 (+10 ms)Region opened successfully at 1676145221399 (+1 ms) 2023-02-11 19:53:41,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c., pid=11, masterSystemTime=1676145221360 2023-02-11 19:53:41,405 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d52518349916d0cbd7809e18f5082b6c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:41,406 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676145221405"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145221405"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145221405"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145221405"}]},"ts":"1676145221405"} 2023-02-11 19:53:41,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:41,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:41,413 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-11 19:53:41,414 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure d52518349916d0cbd7809e18f5082b6c, server=jenkins-hbase4.apache.org,45897,1676145215747 in 202 msec 2023-02-11 19:53:41,418 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-02-11 19:53:41,418 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=d52518349916d0cbd7809e18f5082b6c, ASSIGN in 367 msec 2023-02-11 19:53:41,419 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:53:41,420 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145221419"}]},"ts":"1676145221419"} 2023-02-11 19:53:41,422 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-02-11 19:53:41,426 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:53:41,429 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.2420 sec 2023-02-11 19:53:42,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-11 19:53:42,315 INFO [Listener at localhost/32929] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-02-11 19:53:42,334 DEBUG [hconnection-0x611a5737-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:53:42,337 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48412, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:53:42,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:53:42,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:42,542 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 19:53:42,542 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:42,543 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 19:53:42,543 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 19:53:42,544 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:42,544 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:42,546 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:42,546 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:42,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:42,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:42,547 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:42,547 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:53:42,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:42,548 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:42,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:53:42,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:42,549 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:42,551 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:42,552 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 19:53:42,552 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:42,553 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 19:53:42,556 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:53:42,556 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:42,556 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:53:42,557 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. started... 2023-02-11 19:53:42,558 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d52518349916d0cbd7809e18f5082b6c 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-11 19:53:43,126 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511302c54de9c0a874890b1c4f8a9bfa83abd to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511302c54de9c0a874890b1c4f8a9bfa83abd 2023-02-11 19:53:43,287 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-11 19:53:43,290 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-11 19:53:43,291 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 19:53:43,550 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp/family1/d0744357f6db45c6b7ba231d0c42da3f 2023-02-11 19:53:43,565 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp/family1/d0744357f6db45c6b7ba231d0c42da3f as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/d0744357f6db45c6b7ba231d0c42da3f 2023-02-11 19:53:43,575 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/d0744357f6db45c6b7ba231d0c42da3f, entries=1000, sequenceid=5, filesize=175.8 K 2023-02-11 19:53:43,577 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for d52518349916d0cbd7809e18f5082b6c in 1019ms, sequenceid=5, compaction requested=false 2023-02-11 19:53:43,578 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d52518349916d0cbd7809e18f5082b6c: 2023-02-11 19:53:43,578 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:43,579 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:53:43,579 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:53:43,579 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:43,579 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 19:53:43,579 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 19:53:43,581 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:43,581 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:43,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:43,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:43,582 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,582 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:53:43,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:43,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:43,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:43,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:43,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 19:53:43,584 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 19:53:43,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39b0e34d[Count = 0] remaining members to acquire global barrier 2023-02-11 19:53:43,584 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,586 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,586 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 19:53:43,586 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 19:53:43,586 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:43,586 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:53:43,586 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:53:43,589 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:43,589 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 19:53:43,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:43,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:43,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:43,589 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:43,589 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 19:53:43,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:43,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:43,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:43,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:43,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:43,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:53:43,593 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 19:53:43,593 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:53:43,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 19:53:43,593 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:53:43,593 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,593 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:53:43,596 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,597 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:43,597 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:43,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:43,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:43,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:43,597 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:43,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:43,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:43,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,600 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:43,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:43,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:43,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:43,607 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:43,607 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:43,607 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:43,607 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:43,608 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:43,608 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:43,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 19:53:43,608 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:43,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:53:43,608 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,608 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,608 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:43,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:43,611 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 19:53:43,611 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:53:43,711 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:53:43,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:53:43,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:53:43,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 19:53:43,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,737 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 19:53:43,737 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:43,743 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 19:53:43,743 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 19:53:43,744 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,744 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,746 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:43,746 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:43,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:43,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:43,746 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:43,746 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:53:43,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:53:43,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,748 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,748 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 19:53:43,748 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:43,748 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 19:53:43,748 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:43,749 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 19:53:43,749 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:53:43,749 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:53:43,749 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:43,749 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. started... 2023-02-11 19:53:43,749 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d52518349916d0cbd7809e18f5082b6c 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-11 19:53:43,954 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 19:53:44,178 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511287e1bebebe74d465e99ff3111f28b1e50 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511287e1bebebe74d465e99ff3111f28b1e50 2023-02-11 19:53:44,590 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp/family1/02c032c4e5d547e5a24b073e4ccaa5e7 2023-02-11 19:53:44,599 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp/family1/02c032c4e5d547e5a24b073e4ccaa5e7 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/02c032c4e5d547e5a24b073e4ccaa5e7 2023-02-11 19:53:44,607 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/02c032c4e5d547e5a24b073e4ccaa5e7, entries=1, sequenceid=9, filesize=5.0 K 2023-02-11 19:53:44,609 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for d52518349916d0cbd7809e18f5082b6c in 860ms, sequenceid=9, compaction requested=false 2023-02-11 19:53:44,609 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d52518349916d0cbd7809e18f5082b6c: 2023-02-11 19:53:44,609 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:44,609 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:53:44,610 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:53:44,610 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:44,610 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 19:53:44,610 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 19:53:44,612 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:44,612 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:44,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:44,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:44,613 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,613 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:53:44,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:44,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:44,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:44,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:44,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 19:53:44,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bf09c67[Count = 0] remaining members to acquire global barrier 2023-02-11 19:53:44,615 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 19:53:44,615 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,617 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,617 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 19:53:44,617 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 19:53:44,617 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:53:44,617 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:44,618 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:53:44,619 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:44,619 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 19:53:44,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:44,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:44,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:44,619 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:44,619 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 19:53:44,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:44,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:44,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:44,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:44,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:44,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:53:44,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 19:53:44,623 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 19:53:44,623 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:53:44,623 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:53:44,623 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,623 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:53:44,630 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,630 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,631 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:44,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:44,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:44,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:44,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:44,631 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:44,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:44,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:44,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,633 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:44,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:44,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:44,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:44,638 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:44,638 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,638 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,638 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:44,638 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:44,638 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:44,638 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-11 19:53:44,638 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 19:53:44,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:53:44,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:44,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:44,638 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:44,639 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,639 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,639 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 19:53:44,640 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:53:44,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:44,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:44,740 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:53:44,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:53:44,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:53:44,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 19:53:44,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,752 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 19:53:44,752 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:44,752 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 19:53:44,752 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 19:53:44,753 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,753 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,755 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:44,755 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:44,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:44,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:44,755 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:44,755 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:53:44,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:53:44,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,756 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,756 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 19:53:44,757 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:44,757 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 19:53:44,757 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:44,757 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 19:53:44,757 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:53:44,757 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:53:44,757 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:44,757 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. started... 2023-02-11 19:53:44,758 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d52518349916d0cbd7809e18f5082b6c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:53:44,784 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 19:53:44,784 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-11 19:53:45,186 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201e4ee80fc93ea4df090761adea6a1957e to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201e4ee80fc93ea4df090761adea6a1957e 2023-02-11 19:53:45,599 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp/family1/c6694c6e7b6e44d6ae185d0415169675 2023-02-11 19:53:45,607 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp/family1/c6694c6e7b6e44d6ae185d0415169675 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/c6694c6e7b6e44d6ae185d0415169675 2023-02-11 19:53:45,615 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/c6694c6e7b6e44d6ae185d0415169675, entries=1, sequenceid=13, filesize=5.0 K 2023-02-11 19:53:45,617 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d52518349916d0cbd7809e18f5082b6c in 860ms, sequenceid=13, compaction requested=true 2023-02-11 19:53:45,617 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d52518349916d0cbd7809e18f5082b6c: 2023-02-11 19:53:45,617 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:45,617 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:53:45,618 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:53:45,618 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:45,618 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 19:53:45,618 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 19:53:45,620 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:45,620 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:45,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:45,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:45,621 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,621 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:53:45,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:45,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:45,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:45,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:45,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 19:53:45,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@125f1f85[Count = 0] remaining members to acquire global barrier 2023-02-11 19:53:45,623 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 19:53:45,623 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,624 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,624 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 19:53:45,624 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 19:53:45,624 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:53:45,624 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:45,624 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:53:45,631 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:45,631 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 19:53:45,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:45,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:45,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:45,631 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:45,631 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 19:53:45,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:45,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:45,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:45,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:45,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:45,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:53:45,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 19:53:45,634 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 19:53:45,634 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:53:45,634 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:53:45,634 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,634 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:53:45,636 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,636 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:45,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,636 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:45,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:45,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:45,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:45,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:45,637 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:45,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:45,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,639 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:45,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:45,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:45,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:45,642 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:45,642 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:45,642 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:45,642 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:45,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 19:53:45,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:53:45,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:45,642 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,642 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:45,643 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:45,643 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,643 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,643 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,643 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-11 19:53:45,643 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 19:53:45,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:45,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:45,643 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:53:45,744 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:53:45,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:53:45,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:53:45,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 19:53:45,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,755 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 19:53:45,755 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:45,756 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 19:53:45,756 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 19:53:45,756 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,756 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,758 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:45,758 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:45,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:45,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:45,758 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:45,758 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:53:45,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,759 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:53:45,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,759 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,759 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 19:53:45,759 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:45,760 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 19:53:45,760 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:45,760 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 19:53:45,760 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:53:45,760 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:53:45,760 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:45,760 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. started... 2023-02-11 19:53:45,760 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d52518349916d0cbd7809e18f5082b6c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:53:46,186 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052da125dcadbd4984a47bb9a731228eb8 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512052da125dcadbd4984a47bb9a731228eb8 2023-02-11 19:53:46,598 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp/family1/d2d21f41b9d543e3b0461eacab9c571e 2023-02-11 19:53:46,606 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp/family1/d2d21f41b9d543e3b0461eacab9c571e as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/d2d21f41b9d543e3b0461eacab9c571e 2023-02-11 19:53:46,614 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/d2d21f41b9d543e3b0461eacab9c571e, entries=1, sequenceid=17, filesize=5.0 K 2023-02-11 19:53:46,615 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d52518349916d0cbd7809e18f5082b6c in 855ms, sequenceid=17, compaction requested=true 2023-02-11 19:53:46,615 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d52518349916d0cbd7809e18f5082b6c: 2023-02-11 19:53:46,615 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:46,615 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:53:46,616 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:53:46,616 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:46,616 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 19:53:46,616 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 19:53:46,619 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:46,619 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:46,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:46,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:46,619 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,619 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:53:46,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:46,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:46,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:46,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:46,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 19:53:46,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d50a248[Count = 0] remaining members to acquire global barrier 2023-02-11 19:53:46,621 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 19:53:46,621 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,622 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,622 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 19:53:46,623 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 19:53:46,623 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:53:46,623 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:46,623 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:53:46,624 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:46,625 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 19:53:46,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:46,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:46,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:46,625 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:46,625 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 19:53:46,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:46,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:46,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:46,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:46,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:46,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:53:46,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 19:53:46,628 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 19:53:46,629 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:53:46,629 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:53:46,629 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,629 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:53:46,631 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,631 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:46,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:46,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,631 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:46,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:46,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:46,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:46,631 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:46,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:46,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:46,633 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:46,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:46,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:46,638 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:46,638 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:46,638 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:46,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:46,638 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:46,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 19:53:46,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:53:46,638 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:46,639 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,639 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:46,639 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,639 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,639 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,639 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 19:53:46,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:46,639 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:53:46,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:46,739 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:53:46,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:53:46,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:53:46,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 19:53:46,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,750 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 19:53:46,751 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:46,751 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 19:53:46,751 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 19:53:46,751 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,752 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,753 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:46,753 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:46,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:46,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:46,753 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:46,753 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:53:46,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:53:46,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,754 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,754 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 19:53:46,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:46,755 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 19:53:46,755 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:46,755 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 19:53:46,755 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:53:46,755 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:53:46,755 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:46,755 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. started... 2023-02-11 19:53:46,755 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d52518349916d0cbd7809e18f5082b6c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:53:47,179 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228ca4015dfced14a3a87f1743e7cd0314e to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228ca4015dfced14a3a87f1743e7cd0314e 2023-02-11 19:53:47,590 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp/family1/5591532941db48b49ea421f796bb1ee8 2023-02-11 19:53:47,599 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp/family1/5591532941db48b49ea421f796bb1ee8 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/5591532941db48b49ea421f796bb1ee8 2023-02-11 19:53:47,606 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/5591532941db48b49ea421f796bb1ee8, entries=1, sequenceid=21, filesize=5.0 K 2023-02-11 19:53:47,607 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d52518349916d0cbd7809e18f5082b6c in 852ms, sequenceid=21, compaction requested=true 2023-02-11 19:53:47,608 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d52518349916d0cbd7809e18f5082b6c: 2023-02-11 19:53:47,608 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:47,608 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:53:47,608 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:53:47,608 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:47,608 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 19:53:47,608 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 19:53:47,613 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:47,613 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:47,613 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:47,613 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:53:47,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:47,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:47,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:47,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 19:53:47,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43448c24[Count = 0] remaining members to acquire global barrier 2023-02-11 19:53:47,615 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 19:53:47,615 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,621 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,621 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 19:53:47,622 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 19:53:47,622 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:47,622 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:53:47,622 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:53:47,623 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 19:53:47,623 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:47,623 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:47,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:47,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:47,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:47,623 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 19:53:47,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:47,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:47,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:47,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:47,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:47,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:53:47,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 19:53:47,626 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 19:53:47,626 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:53:47,627 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:53:47,627 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,627 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:53:47,628 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,628 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:47,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:47,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,628 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:47,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:47,629 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:47,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:47,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:47,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:47,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,630 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:47,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:47,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:47,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:47,633 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:47,633 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,633 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:47,633 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:47,633 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:47,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 19:53:47,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:53:47,633 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:47,633 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:47,633 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-11 19:53:47,633 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:47,634 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,634 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,634 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 19:53:47,634 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:53:47,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:47,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:47,734 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:53:47,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:53:47,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:53:47,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 19:53:47,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,745 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 19:53:47,746 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:47,746 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 19:53:47,746 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 19:53:47,747 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,747 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,749 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:47,749 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:47,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:47,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:47,749 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:47,750 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:53:47,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:53:47,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,750 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,750 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 19:53:47,751 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:47,751 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 19:53:47,751 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:47,751 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 19:53:47,751 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:53:47,751 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:53:47,752 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:47,752 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. started... 2023-02-11 19:53:47,752 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d52518349916d0cbd7809e18f5082b6c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:53:48,173 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e457755e3d95479b9fb34eed98959bd0 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231e457755e3d95479b9fb34eed98959bd0 2023-02-11 19:53:48,581 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp/family1/9a67304777ee4784828124297a35b482 2023-02-11 19:53:48,590 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp/family1/9a67304777ee4784828124297a35b482 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/9a67304777ee4784828124297a35b482 2023-02-11 19:53:48,600 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/9a67304777ee4784828124297a35b482, entries=1, sequenceid=25, filesize=5.0 K 2023-02-11 19:53:48,601 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d52518349916d0cbd7809e18f5082b6c in 849ms, sequenceid=25, compaction requested=true 2023-02-11 19:53:48,601 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d52518349916d0cbd7809e18f5082b6c: 2023-02-11 19:53:48,602 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:48,602 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:53:48,602 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:53:48,602 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:48,602 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 19:53:48,602 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 19:53:48,604 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,604 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:48,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:48,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:48,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:48,604 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,605 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:53:48,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:48,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:48,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:48,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:48,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 19:53:48,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c58238f[Count = 0] remaining members to acquire global barrier 2023-02-11 19:53:48,607 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 19:53:48,607 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,608 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,608 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 19:53:48,608 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 19:53:48,609 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:53:48,609 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:48,609 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:53:48,610 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 19:53:48,610 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:48,610 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:48,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:48,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:48,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:48,610 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 19:53:48,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:48,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:48,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:48,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:48,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:48,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:53:48,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 19:53:48,614 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 19:53:48,614 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:53:48,614 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:53:48,614 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,614 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:53:48,617 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,617 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,617 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:48,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:48,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:48,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:48,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:48,617 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:48,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:48,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:48,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,619 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:48,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:48,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:48,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:48,622 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:48,622 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:48,622 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 19:53:48,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:53:48,622 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,622 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:48,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:48,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:48,622 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:48,623 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-11 19:53:48,623 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 19:53:48,622 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:48,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:48,623 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:53:48,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:48,623 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,623 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,623 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,723 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:53:48,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:53:48,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:53:48,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 19:53:48,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,734 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 19:53:48,734 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:48,734 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 19:53:48,735 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 19:53:48,735 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,735 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,737 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:48,737 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:48,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:48,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:48,737 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:48,737 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:53:48,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:53:48,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,738 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,739 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 19:53:48,739 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:48,739 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 19:53:48,739 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:48,739 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 19:53:48,739 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:53:48,739 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:53:48,740 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:48,740 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. started... 2023-02-11 19:53:48,740 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d52518349916d0cbd7809e18f5082b6c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:53:49,163 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010164b0e7a74c624819a469a1469afc1841 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010164b0e7a74c624819a469a1469afc1841 2023-02-11 19:53:49,572 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp/family1/528703357e0c447aa53bda9d84ac1f95 2023-02-11 19:53:49,580 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp/family1/528703357e0c447aa53bda9d84ac1f95 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/528703357e0c447aa53bda9d84ac1f95 2023-02-11 19:53:49,588 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/528703357e0c447aa53bda9d84ac1f95, entries=1, sequenceid=29, filesize=5.0 K 2023-02-11 19:53:49,589 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d52518349916d0cbd7809e18f5082b6c in 849ms, sequenceid=29, compaction requested=true 2023-02-11 19:53:49,589 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d52518349916d0cbd7809e18f5082b6c: 2023-02-11 19:53:49,589 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:49,589 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:53:49,590 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:53:49,590 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:49,590 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 19:53:49,590 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 19:53:49,592 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,592 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:49,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:49,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:49,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:49,592 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,592 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:53:49,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:49,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:49,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:49,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:49,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 19:53:49,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2691aeb6[Count = 0] remaining members to acquire global barrier 2023-02-11 19:53:49,594 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 19:53:49,594 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,597 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,597 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 19:53:49,597 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 19:53:49,597 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:49,597 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:53:49,597 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:53:49,599 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 19:53:49,599 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:49,599 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:49,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:49,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:49,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:49,599 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 19:53:49,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:49,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:49,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:49,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:49,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:49,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:53:49,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 19:53:49,602 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 19:53:49,602 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:53:49,602 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:53:49,602 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,602 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:53:49,604 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,604 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:49,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:49,604 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:49,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:49,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:49,605 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:49,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:49,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:49,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,606 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:49,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:49,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:49,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:49,612 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:49,612 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:49,612 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:49,612 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-11 19:53:49,612 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 19:53:49,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:53:49,612 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:49,612 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:49,612 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:49,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:49,613 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,613 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,613 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,613 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 19:53:49,613 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:53:49,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:49,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:49,713 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:53:49,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:53:49,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:53:49,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 19:53:49,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,724 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 19:53:49,724 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:49,724 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 19:53:49,724 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 19:53:49,725 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,725 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,726 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:49,726 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:49,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:49,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:49,726 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:49,726 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:53:49,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:53:49,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,727 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,728 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 19:53:49,728 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:49,728 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 19:53:49,728 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:49,728 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 19:53:49,728 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:53:49,728 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:53:49,728 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:49,728 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. started... 2023-02-11 19:53:49,729 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d52518349916d0cbd7809e18f5082b6c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:53:50,149 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b3598e54cc3a410b8fcb81733b2553ee to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b3598e54cc3a410b8fcb81733b2553ee 2023-02-11 19:53:50,558 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp/family1/af24fbbadcf74e90b8c6c4cdd4a8fc45 2023-02-11 19:53:50,566 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp/family1/af24fbbadcf74e90b8c6c4cdd4a8fc45 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/af24fbbadcf74e90b8c6c4cdd4a8fc45 2023-02-11 19:53:50,573 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/af24fbbadcf74e90b8c6c4cdd4a8fc45, entries=1, sequenceid=33, filesize=5.0 K 2023-02-11 19:53:50,574 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d52518349916d0cbd7809e18f5082b6c in 845ms, sequenceid=33, compaction requested=true 2023-02-11 19:53:50,574 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d52518349916d0cbd7809e18f5082b6c: 2023-02-11 19:53:50,574 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:50,574 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:53:50,575 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:53:50,575 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:50,575 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 19:53:50,575 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 19:53:50,577 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:50,577 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:50,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:50,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:50,577 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,577 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:53:50,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:50,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:50,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:50,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:50,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 19:53:50,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e2b1ace[Count = 0] remaining members to acquire global barrier 2023-02-11 19:53:50,579 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 19:53:50,579 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,580 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,580 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 19:53:50,581 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 19:53:50,581 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:53:50,581 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:50,581 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:53:50,583 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 19:53:50,583 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:50,583 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:50,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:50,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:50,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:50,583 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 19:53:50,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:50,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:50,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:50,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:50,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:50,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:53:50,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 19:53:50,586 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 19:53:50,586 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:53:50,586 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:53:50,586 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,586 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:53:50,588 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,588 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:50,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:50,588 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:50,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:50,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:50,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:50,589 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:50,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:50,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:50,590 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:50,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:50,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:50,593 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:50,593 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,593 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:50,593 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,593 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:50,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-11 19:53:50,593 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:50,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 19:53:50,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:53:50,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:50,593 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:50,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:50,593 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,594 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,594 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,594 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 19:53:50,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:50,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:50,594 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:53:50,694 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:53:50,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:53:50,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:53:50,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 19:53:50,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,707 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 19:53:50,707 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:50,707 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 19:53:50,707 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 19:53:50,707 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,707 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,709 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:50,709 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:50,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:50,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:50,709 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:50,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,709 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:53:50,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:53:50,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,710 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,710 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 19:53:50,710 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:50,711 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 19:53:50,711 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:50,711 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 19:53:50,711 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:53:50,711 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:53:50,711 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:50,711 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. started... 2023-02-11 19:53:50,711 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d52518349916d0cbd7809e18f5082b6c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:53:51,131 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907c851ebb64656428a9e87e9e381a04bc8 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907c851ebb64656428a9e87e9e381a04bc8 2023-02-11 19:53:51,540 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp/family1/fadfce79c0d34ea4b24bb4e375252eda 2023-02-11 19:53:51,549 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp/family1/fadfce79c0d34ea4b24bb4e375252eda as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/fadfce79c0d34ea4b24bb4e375252eda 2023-02-11 19:53:51,555 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/fadfce79c0d34ea4b24bb4e375252eda, entries=1, sequenceid=37, filesize=5.0 K 2023-02-11 19:53:51,557 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d52518349916d0cbd7809e18f5082b6c in 846ms, sequenceid=37, compaction requested=true 2023-02-11 19:53:51,557 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d52518349916d0cbd7809e18f5082b6c: 2023-02-11 19:53:51,557 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:51,557 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:53:51,557 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:53:51,557 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:51,557 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 19:53:51,557 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 19:53:51,560 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,560 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:51,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:51,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:51,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:51,560 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,560 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:53:51,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:51,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:51,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:51,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:51,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 19:53:51,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39e99883[Count = 0] remaining members to acquire global barrier 2023-02-11 19:53:51,562 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 19:53:51,562 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,563 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,564 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 19:53:51,564 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 19:53:51,564 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:53:51,564 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:51,564 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:53:51,565 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:51,565 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 19:53:51,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:51,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:51,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:51,565 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:51,565 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 19:53:51,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:51,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:51,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:51,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:51,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:51,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:53:51,568 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 19:53:51,568 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 19:53:51,568 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:53:51,568 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:53:51,568 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,568 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:53:51,570 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,570 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:51,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:51,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,570 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:51,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:51,571 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:51,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:51,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:51,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:51,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:51,572 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:51,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:51,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:51,575 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:51,575 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,575 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:51,575 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,575 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:51,575 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:51,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 19:53:51,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:53:51,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:51,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:51,575 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:51,576 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,576 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,576 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:51,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:51,576 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 19:53:51,577 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:53:51,677 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:53:51,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:53:51,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:53:51,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 19:53:51,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,687 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 19:53:51,687 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:51,687 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 19:53:51,687 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 19:53:51,688 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,688 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,689 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:51,689 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:51,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:51,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:51,689 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:51,689 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:53:51,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:53:51,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,691 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,691 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 19:53:51,691 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:51,691 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 19:53:51,691 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:51,692 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 19:53:51,692 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:53:51,692 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:53:51,692 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:51,692 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. started... 2023-02-11 19:53:51,693 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d52518349916d0cbd7809e18f5082b6c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:53:52,114 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120a474c0b6caed45bd9c0affcb600e57c2 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120a474c0b6caed45bd9c0affcb600e57c2 2023-02-11 19:53:52,523 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp/family1/726d06ac07424879ac6bd01ebc25e5a7 2023-02-11 19:53:52,530 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp/family1/726d06ac07424879ac6bd01ebc25e5a7 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/726d06ac07424879ac6bd01ebc25e5a7 2023-02-11 19:53:52,536 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/726d06ac07424879ac6bd01ebc25e5a7, entries=1, sequenceid=41, filesize=5.0 K 2023-02-11 19:53:52,537 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d52518349916d0cbd7809e18f5082b6c in 844ms, sequenceid=41, compaction requested=true 2023-02-11 19:53:52,537 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d52518349916d0cbd7809e18f5082b6c: 2023-02-11 19:53:52,537 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:52,537 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:53:52,538 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:53:52,538 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:52,538 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 19:53:52,538 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 19:53:52,540 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:52,540 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:52,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:52,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:52,540 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,540 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:53:52,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:52,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:52,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:52,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:52,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 19:53:52,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34a0906a[Count = 0] remaining members to acquire global barrier 2023-02-11 19:53:52,541 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 19:53:52,542 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,543 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,543 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 19:53:52,543 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 19:53:52,543 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:53:52,543 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:52,543 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:53:52,548 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 19:53:52,548 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:52,548 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:52,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:52,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:52,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:52,548 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 19:53:52,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:52,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:52,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:52,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:52,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:52,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:53:52,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 19:53:52,552 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 19:53:52,552 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:53:52,552 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:53:52,552 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,552 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:53:52,554 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,554 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:52,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:52,554 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:52,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:52,554 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:52,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:52,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:52,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:52,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,556 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:52,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:52,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:52,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:52,558 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:52,558 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,558 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:52,558 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:52,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 19:53:52,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:53:52,558 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:52,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:52,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-11 19:53:52,558 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:52,558 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:52,559 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,559 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,559 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,559 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 19:53:52,559 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:53:52,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:52,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:52,659 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:53:52,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:53:52,665 DEBUG [Listener at localhost/32929] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 19:53:52,668 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56420, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 19:53:52,669 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40445] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:52,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-11 19:53:52,683 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-11 19:53:52,684 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676145832684 2023-02-11 19:53:52,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:53:52,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 19:53:52,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-11 19:53:52,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 19:53:52,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] zookeeper.ReadOnlyZKClient(139): Connect 0x48995002 to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:53:52,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6854030d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:53:52,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 19:53:53,603 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103da2a5d711d6443d9b5784f35c59dfb0d to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103da2a5d711d6443d9b5784f35c59dfb0d 2023-02-11 19:53:53,604 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 19:53:53,623 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:53:53,625 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50728, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:53:53,635 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:53:53,637 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47502, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:53:53,670 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/dbace6f060ce4baebd079409b7b02c90 first=Optional[r3] last=Optional[r6] 2023-02-11 19:53:53,683 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/dbace6f060ce4baebd079409b7b02c90}] 2023-02-11 19:53:53,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/dbace6f060ce4baebd079409b7b02c90 for inclusion in d52518349916d0cbd7809e18f5082b6c/family1 2023-02-11 19:53:53,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-11 19:53:53,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 19:53:53,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for d52518349916d0cbd7809e18f5082b6c: 2023-02-11 19:53:53,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/dbace6f060ce4baebd079409b7b02c90 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__3527iipba2jdveqlrcfpcg8aqgi83rl2cnemtntaj9igali5km2cm3a02jdjasbl/family1/dbace6f060ce4baebd079409b7b02c90 2023-02-11 19:53:53,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__3527iipba2jdveqlrcfpcg8aqgi83rl2cnemtntaj9igali5km2cm3a02jdjasbl/family1/dbace6f060ce4baebd079409b7b02c90 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/53685ed5ad18485e95bfe521e699f23c_SeqId_44_ 2023-02-11 19:53:53,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__3527iipba2jdveqlrcfpcg8aqgi83rl2cnemtntaj9igali5km2cm3a02jdjasbl/family1/dbace6f060ce4baebd079409b7b02c90 into d52518349916d0cbd7809e18f5082b6c/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/53685ed5ad18485e95bfe521e699f23c_SeqId_44_ - updating store file list. 2023-02-11 19:53:53,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/53685ed5ad18485e95bfe521e699f23c_SeqId_44_ into d52518349916d0cbd7809e18f5082b6c/family1 2023-02-11 19:53:53,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__3527iipba2jdveqlrcfpcg8aqgi83rl2cnemtntaj9igali5km2cm3a02jdjasbl/family1/dbace6f060ce4baebd079409b7b02c90 into d52518349916d0cbd7809e18f5082b6c/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/53685ed5ad18485e95bfe521e699f23c_SeqId_44_) 2023-02-11 19:53:53,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__3527iipba2jdveqlrcfpcg8aqgi83rl2cnemtntaj9igali5km2cm3a02jdjasbl/family1/dbace6f060ce4baebd079409b7b02c90 2023-02-11 19:53:53,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-11 19:53:53,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-11 19:53:53,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(1912): d52518349916d0cbd7809e18f5082b6c/family1 is initiating minor compaction 2023-02-11 19:53:53,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@497bd59b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:53:53,726 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of d52518349916d0cbd7809e18f5082b6c/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:53,727 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/02c032c4e5d547e5a24b073e4ccaa5e7, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/c6694c6e7b6e44d6ae185d0415169675, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/d2d21f41b9d543e3b0461eacab9c571e, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/5591532941db48b49ea421f796bb1ee8, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/9a67304777ee4784828124297a35b482, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/528703357e0c447aa53bda9d84ac1f95, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/af24fbbadcf74e90b8c6c4cdd4a8fc45, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/fadfce79c0d34ea4b24bb4e375252eda, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/726d06ac07424879ac6bd01ebc25e5a7, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/53685ed5ad18485e95bfe521e699f23c_SeqId_44_] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp, totalSize=50.2 K 2023-02-11 19:53:53,728 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 02c032c4e5d547e5a24b073e4ccaa5e7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 19:53:53,728 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting c6694c6e7b6e44d6ae185d0415169675, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 19:53:53,728 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting d2d21f41b9d543e3b0461eacab9c571e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-11 19:53:53,728 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 5591532941db48b49ea421f796bb1ee8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-11 19:53:53,728 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 9a67304777ee4784828124297a35b482, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-11 19:53:53,728 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 528703357e0c447aa53bda9d84ac1f95, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-11 19:53:53,728 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting af24fbbadcf74e90b8c6c4cdd4a8fc45, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-11 19:53:53,728 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting fadfce79c0d34ea4b24bb4e375252eda, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-11 19:53:53,728 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 726d06ac07424879ac6bd01ebc25e5a7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-11 19:53:53,728 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 53685ed5ad18485e95bfe521e699f23c_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-11 19:53:53,740 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 19:53:53,741 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:53:53,747 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228ca4015dfced14a3a87f1743e7cd0314e to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228ca4015dfced14a3a87f1743e7cd0314e 2023-02-11 19:53:53,749 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231e457755e3d95479b9fb34eed98959bd0 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231e457755e3d95479b9fb34eed98959bd0 2023-02-11 19:53:53,751 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010164b0e7a74c624819a469a1469afc1841 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010164b0e7a74c624819a469a1469afc1841 2023-02-11 19:53:53,753 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b3598e54cc3a410b8fcb81733b2553ee to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b3598e54cc3a410b8fcb81733b2553ee 2023-02-11 19:53:53,753 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-02-11 19:53:53,753 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-11 19:53:53,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 19:53:53,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 19:53:53,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 19:53:53,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 19:53:53,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 19:53:53,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 19:53:53,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 19:53:53,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 19:53:53,781 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] throttle.PressureAwareThroughputController(145): d52518349916d0cbd7809e18f5082b6c#family1#compaction#10 average throughput is 0.24 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:53:54,605 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp/family1/192fa40020274b469592321b58ff8f9c as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/192fa40020274b469592321b58ff8f9c 2023-02-11 19:53:54,622 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in d52518349916d0cbd7809e18f5082b6c/family1 of d52518349916d0cbd7809e18f5082b6c into 192fa40020274b469592321b58ff8f9c(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 19:53:54,623 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for d52518349916d0cbd7809e18f5082b6c: 2023-02-11 19:53:54,627 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1676145233725; duration=0sec 2023-02-11 19:53:54,631 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/02c032c4e5d547e5a24b073e4ccaa5e7, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/c6694c6e7b6e44d6ae185d0415169675, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/d2d21f41b9d543e3b0461eacab9c571e, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/5591532941db48b49ea421f796bb1ee8, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/9a67304777ee4784828124297a35b482, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/528703357e0c447aa53bda9d84ac1f95, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/af24fbbadcf74e90b8c6c4cdd4a8fc45, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/fadfce79c0d34ea4b24bb4e375252eda, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/726d06ac07424879ac6bd01ebc25e5a7, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/53685ed5ad18485e95bfe521e699f23c_SeqId_44_] to archive 2023-02-11 19:53:54,631 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:53:54,632 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:53:54,635 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/02c032c4e5d547e5a24b073e4ccaa5e7 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/02c032c4e5d547e5a24b073e4ccaa5e7 2023-02-11 19:53:54,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/c6694c6e7b6e44d6ae185d0415169675 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/c6694c6e7b6e44d6ae185d0415169675 2023-02-11 19:53:54,639 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/d2d21f41b9d543e3b0461eacab9c571e to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/d2d21f41b9d543e3b0461eacab9c571e 2023-02-11 19:53:54,639 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205b0a40905d34545bea2f76aa242fa7e09 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205b0a40905d34545bea2f76aa242fa7e09 2023-02-11 19:53:54,640 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 19:53:54,641 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/5591532941db48b49ea421f796bb1ee8 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/5591532941db48b49ea421f796bb1ee8 2023-02-11 19:53:54,643 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/9a67304777ee4784828124297a35b482 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/9a67304777ee4784828124297a35b482 2023-02-11 19:53:54,645 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/528703357e0c447aa53bda9d84ac1f95 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/528703357e0c447aa53bda9d84ac1f95 2023-02-11 19:53:54,647 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/af24fbbadcf74e90b8c6c4cdd4a8fc45 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/af24fbbadcf74e90b8c6c4cdd4a8fc45 2023-02-11 19:53:54,648 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/fadfce79c0d34ea4b24bb4e375252eda to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/fadfce79c0d34ea4b24bb4e375252eda 2023-02-11 19:53:54,650 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/726d06ac07424879ac6bd01ebc25e5a7 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/726d06ac07424879ac6bd01ebc25e5a7 2023-02-11 19:53:54,651 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/53685ed5ad18485e95bfe521e699f23c_SeqId_44_ to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/53685ed5ad18485e95bfe521e699f23c_SeqId_44_ 2023-02-11 19:53:54,672 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1a1e1aa47e0b4498aec24ffc0091b66b first=Optional[r00] last=Optional[r2] 2023-02-11 19:53:54,675 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1a1e1aa47e0b4498aec24ffc0091b66b}] 2023-02-11 19:53:54,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1a1e1aa47e0b4498aec24ffc0091b66b for inclusion in d52518349916d0cbd7809e18f5082b6c/family1 2023-02-11 19:53:54,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-11 19:53:54,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 19:53:54,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for d52518349916d0cbd7809e18f5082b6c: 2023-02-11 19:53:54,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1a1e1aa47e0b4498aec24ffc0091b66b to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__dm83uvt937kc1icjf9q9pkk7a1ran6njrnuln7te275krskof2sg5oe8g3d7e7fp/family1/1a1e1aa47e0b4498aec24ffc0091b66b 2023-02-11 19:53:54,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__dm83uvt937kc1icjf9q9pkk7a1ran6njrnuln7te275krskof2sg5oe8g3d7e7fp/family1/1a1e1aa47e0b4498aec24ffc0091b66b as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/dd2689b3a70445f0a2e8713f5f7708b5_SeqId_47_ 2023-02-11 19:53:54,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__dm83uvt937kc1icjf9q9pkk7a1ran6njrnuln7te275krskof2sg5oe8g3d7e7fp/family1/1a1e1aa47e0b4498aec24ffc0091b66b into d52518349916d0cbd7809e18f5082b6c/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/dd2689b3a70445f0a2e8713f5f7708b5_SeqId_47_ - updating store file list. 2023-02-11 19:53:54,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/dd2689b3a70445f0a2e8713f5f7708b5_SeqId_47_ into d52518349916d0cbd7809e18f5082b6c/family1 2023-02-11 19:53:54,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__dm83uvt937kc1icjf9q9pkk7a1ran6njrnuln7te275krskof2sg5oe8g3d7e7fp/family1/1a1e1aa47e0b4498aec24ffc0091b66b into d52518349916d0cbd7809e18f5082b6c/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/dd2689b3a70445f0a2e8713f5f7708b5_SeqId_47_) 2023-02-11 19:53:54,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__dm83uvt937kc1icjf9q9pkk7a1ran6njrnuln7te275krskof2sg5oe8g3d7e7fp/family1/1a1e1aa47e0b4498aec24ffc0091b66b 2023-02-11 19:53:54,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-11 19:53:54,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-11 19:53:54,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(1912): d52518349916d0cbd7809e18f5082b6c/family1 is initiating minor compaction (all files) 2023-02-11 19:53:54,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@17932fdb; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:53:54,699 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of d52518349916d0cbd7809e18f5082b6c/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:54,699 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/d0744357f6db45c6b7ba231d0c42da3f, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/192fa40020274b469592321b58ff8f9c, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/dd2689b3a70445f0a2e8713f5f7708b5_SeqId_47_] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp, totalSize=358.6 K 2023-02-11 19:53:54,700 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting d0744357f6db45c6b7ba231d0c42da3f, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878840136 2023-02-11 19:53:54,700 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 192fa40020274b469592321b58ff8f9c, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621240136 2023-02-11 19:53:54,701 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting dd2689b3a70445f0a2e8713f5f7708b5_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878840136 2023-02-11 19:53:54,702 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 19:53:54,702 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:53:54,705 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511302c54de9c0a874890b1c4f8a9bfa83abd to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511302c54de9c0a874890b1c4f8a9bfa83abd 2023-02-11 19:53:54,707 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201e4ee80fc93ea4df090761adea6a1957e to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201e4ee80fc93ea4df090761adea6a1957e 2023-02-11 19:53:54,710 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512052da125dcadbd4984a47bb9a731228eb8 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512052da125dcadbd4984a47bb9a731228eb8 2023-02-11 19:53:54,710 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-02-11 19:53:54,710 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-11 19:53:54,710 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 19:53:54,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 19:53:54,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:53:54,712 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-11 19:53:54,715 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 2.0380 sec 2023-02-11 19:53:54,751 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] throttle.PressureAwareThroughputController(145): d52518349916d0cbd7809e18f5082b6c#family1#compaction#11 average throughput is 4.72 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:53:54,789 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/.tmp/family1/2f313022148949be8df21f868b5de079 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/2f313022148949be8df21f868b5de079 2023-02-11 19:53:54,798 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in d52518349916d0cbd7809e18f5082b6c/family1 of d52518349916d0cbd7809e18f5082b6c into 2f313022148949be8df21f868b5de079(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 19:53:54,798 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for d52518349916d0cbd7809e18f5082b6c: 2023-02-11 19:53:54,799 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1676145234698; duration=0sec 2023-02-11 19:53:54,799 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:53:54,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/d0744357f6db45c6b7ba231d0c42da3f, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/192fa40020274b469592321b58ff8f9c, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/dd2689b3a70445f0a2e8713f5f7708b5_SeqId_47_] to archive 2023-02-11 19:53:54,822 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:53:54,825 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/d0744357f6db45c6b7ba231d0c42da3f to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/d0744357f6db45c6b7ba231d0c42da3f 2023-02-11 19:53:54,827 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/192fa40020274b469592321b58ff8f9c to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/192fa40020274b469592321b58ff8f9c 2023-02-11 19:53:54,829 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/dd2689b3a70445f0a2e8713f5f7708b5_SeqId_47_ to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/dd2689b3a70445f0a2e8713f5f7708b5_SeqId_47_ 2023-02-11 19:53:54,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-11 19:53:54,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:55,287 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-11 19:53:55,289 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-11 19:53:55,289 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-11 19:53:55,295 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-02-11 19:53:55,311 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=d52518349916d0cbd7809e18f5082b6c, REOPEN/MOVE}] 2023-02-11 19:53:55,312 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=d52518349916d0cbd7809e18f5082b6c, REOPEN/MOVE 2023-02-11 19:53:55,313 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=d52518349916d0cbd7809e18f5082b6c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:55,314 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676145235313"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145235313"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145235313"}]},"ts":"1676145235313"} 2023-02-11 19:53:55,317 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure d52518349916d0cbd7809e18f5082b6c, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:53:55,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d52518349916d0cbd7809e18f5082b6c 2023-02-11 19:53:55,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d52518349916d0cbd7809e18f5082b6c, disabling compactions & flushes 2023-02-11 19:53:55,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:55,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:55,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. after waiting 0 ms 2023-02-11 19:53:55,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:55,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-11 19:53:55,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:55,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d52518349916d0cbd7809e18f5082b6c: Waiting for close lock at 1676145235477Running coprocessor pre-close hooks at 1676145235477Disabling compacts and flushes for region at 1676145235477Disabling writes for close at 1676145235477Writing region close event to WAL at 1676145235479 (+2 ms)Running coprocessor post-close hooks at 1676145235484 (+5 ms)Closed at 1676145235484 2023-02-11 19:53:55,484 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: d52518349916d0cbd7809e18f5082b6c to self. 2023-02-11 19:53:55,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d52518349916d0cbd7809e18f5082b6c 2023-02-11 19:53:55,487 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=d52518349916d0cbd7809e18f5082b6c, regionState=CLOSED 2023-02-11 19:53:55,487 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676145235487"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145235487"}]},"ts":"1676145235487"} 2023-02-11 19:53:55,491 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-11 19:53:55,491 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure d52518349916d0cbd7809e18f5082b6c, server=jenkins-hbase4.apache.org,45897,1676145215747 in 172 msec 2023-02-11 19:53:55,492 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=d52518349916d0cbd7809e18f5082b6c, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=true 2023-02-11 19:53:55,642 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=d52518349916d0cbd7809e18f5082b6c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:55,643 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676145235642"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145235642"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145235642"}]},"ts":"1676145235642"} 2023-02-11 19:53:55,645 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure d52518349916d0cbd7809e18f5082b6c, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:53:55,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:55,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d52518349916d0cbd7809e18f5082b6c, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:53:55,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly d52518349916d0cbd7809e18f5082b6c 2023-02-11 19:53:55,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:53:55,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d52518349916d0cbd7809e18f5082b6c 2023-02-11 19:53:55,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d52518349916d0cbd7809e18f5082b6c 2023-02-11 19:53:55,803 INFO [StoreOpener-d52518349916d0cbd7809e18f5082b6c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d52518349916d0cbd7809e18f5082b6c 2023-02-11 19:53:55,804 DEBUG [StoreOpener-d52518349916d0cbd7809e18f5082b6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1 2023-02-11 19:53:55,804 DEBUG [StoreOpener-d52518349916d0cbd7809e18f5082b6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1 2023-02-11 19:53:55,805 INFO [StoreOpener-d52518349916d0cbd7809e18f5082b6c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d52518349916d0cbd7809e18f5082b6c columnFamilyName family1 2023-02-11 19:53:55,812 DEBUG [StoreOpener-d52518349916d0cbd7809e18f5082b6c-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/2f313022148949be8df21f868b5de079 2023-02-11 19:53:55,812 INFO [StoreOpener-d52518349916d0cbd7809e18f5082b6c-1] regionserver.HStore(310): Store=d52518349916d0cbd7809e18f5082b6c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:53:55,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c 2023-02-11 19:53:55,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c 2023-02-11 19:53:55,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d52518349916d0cbd7809e18f5082b6c 2023-02-11 19:53:55,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d52518349916d0cbd7809e18f5082b6c; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67744164, jitterRate=0.009466707706451416}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:53:55,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d52518349916d0cbd7809e18f5082b6c: Running coprocessor pre-open hook at 1676145235802Writing region info on filesystem at 1676145235802Initializing all the Stores at 1676145235803 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676145235803Cleaning up temporary data from old regions at 1676145235816 (+13 ms)Cleaning up detritus from prior splits at 1676145235816Running coprocessor post-open hooks at 1676145235820 (+4 ms)Region opened successfully at 1676145235820 2023-02-11 19:53:55,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c., pid=17, masterSystemTime=1676145235797 2023-02-11 19:53:55,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:55,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:53:55,824 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=d52518349916d0cbd7809e18f5082b6c, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:55,824 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676145235824"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145235824"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145235824"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145235824"}]},"ts":"1676145235824"} 2023-02-11 19:53:55,829 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-02-11 19:53:55,829 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure d52518349916d0cbd7809e18f5082b6c, server=jenkins-hbase4.apache.org,45897,1676145215747 in 181 msec 2023-02-11 19:53:55,839 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-02-11 19:53:55,839 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=d52518349916d0cbd7809e18f5082b6c, REOPEN/MOVE in 518 msec 2023-02-11 19:53:55,842 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-02-11 19:53:55,842 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 546 msec 2023-02-11 19:53:55,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 976 msec 2023-02-11 19:53:55,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-02-11 19:53:55,856 INFO [Listener at localhost/32929] compactions.TestMobCompactor(278): alter status finished 2023-02-11 19:53:55,857 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40445] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 19:53:55,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-11 19:53:55,860 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-11 19:53:55,861 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676145835861 2023-02-11 19:53:55,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:53:55,863 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 19:53:55,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-11 19:53:55,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 19:53:55,864 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] zookeeper.ReadOnlyZKClient(139): Connect 0x5e1135e0 to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:53:55,886 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@665c5993, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:53:55,886 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 19:53:55,886 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 19:53:55,886 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 19:53:55,886 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 19:53:55,886 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 19:53:56,730 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283ebb47c8991043ce82537a3a78e1ef02 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511283ebb47c8991043ce82537a3a78e1ef02 2023-02-11 19:53:56,731 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 19:53:56,749 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:53:56,750 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50732, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:53:56,758 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:53:56,760 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47504, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:53:56,772 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/51783f498a164885ab25790013b78287 first=Optional[r05] last=Optional[r8] 2023-02-11 19:53:56,773 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=51 for row with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/51783f498a164885ab25790013b78287}] 2023-02-11 19:53:56,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/51783f498a164885ab25790013b78287 for inclusion in d52518349916d0cbd7809e18f5082b6c/family1 2023-02-11 19:53:56,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-11 19:53:56,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 19:53:56,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for d52518349916d0cbd7809e18f5082b6c: 2023-02-11 19:53:56,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/51783f498a164885ab25790013b78287 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gtfval1g9sh6tmcj3pfpecqgj279rpsqprrq9qr99habejse4i2n0g70aji6jjhf/family1/51783f498a164885ab25790013b78287 2023-02-11 19:53:56,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gtfval1g9sh6tmcj3pfpecqgj279rpsqprrq9qr99habejse4i2n0g70aji6jjhf/family1/51783f498a164885ab25790013b78287 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/86277c73728c49f895a0f805b6daf68e_SeqId_53_ 2023-02-11 19:53:56,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gtfval1g9sh6tmcj3pfpecqgj279rpsqprrq9qr99habejse4i2n0g70aji6jjhf/family1/51783f498a164885ab25790013b78287 into d52518349916d0cbd7809e18f5082b6c/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/86277c73728c49f895a0f805b6daf68e_SeqId_53_ - updating store file list. 2023-02-11 19:53:56,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/86277c73728c49f895a0f805b6daf68e_SeqId_53_ into d52518349916d0cbd7809e18f5082b6c/family1 2023-02-11 19:53:56,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gtfval1g9sh6tmcj3pfpecqgj279rpsqprrq9qr99habejse4i2n0g70aji6jjhf/family1/51783f498a164885ab25790013b78287 into d52518349916d0cbd7809e18f5082b6c/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/family1/86277c73728c49f895a0f805b6daf68e_SeqId_53_) 2023-02-11 19:53:56,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gtfval1g9sh6tmcj3pfpecqgj279rpsqprrq9qr99habejse4i2n0g70aji6jjhf/family1/51783f498a164885ab25790013b78287 2023-02-11 19:53:56,796 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 19:53:56,797 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:53:56,800 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120a474c0b6caed45bd9c0affcb600e57c2 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120a474c0b6caed45bd9c0affcb600e57c2 2023-02-11 19:53:56,801 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511287e1bebebe74d465e99ff3111f28b1e50 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511287e1bebebe74d465e99ff3111f28b1e50 2023-02-11 19:53:56,801 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-02-11 19:53:56,801 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-11 19:53:56,802 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 19:53:56,802 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 19:53:56,802 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 19:53:56,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 19:53:56,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:53:56,803 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-11 19:53:56,805 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 945 msec 2023-02-11 19:53:56,888 INFO [Listener at localhost/32929] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=246 (was 211) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:46718 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5875723c-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:46622 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:58640 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:46606 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:46664 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:46668 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:46724 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64025@0x48995002-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x5875723c-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64025@0x48995002 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/679487775.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2fee3929-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:58614 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64025@0x48995002-SendThread(127.0.0.1:64025) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: (jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64025@0x5e1135e0-SendThread(127.0.0.1:64025) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:58638 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2fee3929-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:45897-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:58678 [Waiting for operation #21] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:58650 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:46638 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5875723c-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64025@0x5e1135e0-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:46616 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64025@0x5e1135e0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/679487775.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:58592 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1611553884_15 at /127.0.0.1:46680 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=588 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=306 (was 385), ProcessCount=168 (was 168), AvailableMemoryMB=4573 (was 4524) - AvailableMemoryMB LEAK? - 2023-02-11 19:53:56,907 INFO [Listener at localhost/32929] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=246, OpenFileDescriptor=590, MaxFileDescriptor=60000, SystemLoadAverage=306, ProcessCount=168, AvailableMemoryMB=4570 2023-02-11 19:53:56,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-11 19:53:56,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:56,913 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:53:56,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-02-11 19:53:56,914 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:53:56,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-11 19:53:56,915 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea 2023-02-11 19:53:56,916 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea empty. 2023-02-11 19:53:56,917 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea 2023-02-11 19:53:56,917 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-02-11 19:53:56,934 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-11 19:53:56,935 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 69b2602d8eb42fd8a253bad1a4ec74ea, NAME => 'testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp 2023-02-11 19:53:57,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-11 19:53:57,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-11 19:53:57,352 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:53:57,352 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing 69b2602d8eb42fd8a253bad1a4ec74ea, disabling compactions & flushes 2023-02-11 19:53:57,352 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:53:57,352 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:53:57,352 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. after waiting 0 ms 2023-02-11 19:53:57,352 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:53:57,353 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:53:57,353 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 69b2602d8eb42fd8a253bad1a4ec74ea: Waiting for close lock at 1676145237352Disabling compacts and flushes for region at 1676145237352Disabling writes for close at 1676145237352Writing region close event to WAL at 1676145237353 (+1 ms)Closed at 1676145237353 2023-02-11 19:53:57,356 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:53:57,357 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676145237357"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145237357"}]},"ts":"1676145237357"} 2023-02-11 19:53:57,359 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 19:53:57,360 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:53:57,360 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145237360"}]},"ts":"1676145237360"} 2023-02-11 19:53:57,362 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-11 19:53:57,365 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=69b2602d8eb42fd8a253bad1a4ec74ea, ASSIGN}] 2023-02-11 19:53:57,367 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=69b2602d8eb42fd8a253bad1a4ec74ea, ASSIGN 2023-02-11 19:53:57,368 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=69b2602d8eb42fd8a253bad1a4ec74ea, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=false 2023-02-11 19:53:57,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-11 19:53:57,519 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=69b2602d8eb42fd8a253bad1a4ec74ea, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:57,520 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676145237519"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145237519"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145237519"}]},"ts":"1676145237519"} 2023-02-11 19:53:57,523 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 69b2602d8eb42fd8a253bad1a4ec74ea, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:53:57,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:53:57,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 69b2602d8eb42fd8a253bad1a4ec74ea, NAME => 'testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:53:57,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 69b2602d8eb42fd8a253bad1a4ec74ea 2023-02-11 19:53:57,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:53:57,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 69b2602d8eb42fd8a253bad1a4ec74ea 2023-02-11 19:53:57,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 69b2602d8eb42fd8a253bad1a4ec74ea 2023-02-11 19:53:57,687 INFO [StoreOpener-69b2602d8eb42fd8a253bad1a4ec74ea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 69b2602d8eb42fd8a253bad1a4ec74ea 2023-02-11 19:53:57,689 DEBUG [StoreOpener-69b2602d8eb42fd8a253bad1a4ec74ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1 2023-02-11 19:53:57,689 DEBUG [StoreOpener-69b2602d8eb42fd8a253bad1a4ec74ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1 2023-02-11 19:53:57,689 INFO [StoreOpener-69b2602d8eb42fd8a253bad1a4ec74ea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 69b2602d8eb42fd8a253bad1a4ec74ea columnFamilyName family1 2023-02-11 19:53:57,691 INFO [StoreOpener-69b2602d8eb42fd8a253bad1a4ec74ea-1] regionserver.HStore(310): Store=69b2602d8eb42fd8a253bad1a4ec74ea/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:53:57,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea 2023-02-11 19:53:57,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea 2023-02-11 19:53:57,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 69b2602d8eb42fd8a253bad1a4ec74ea 2023-02-11 19:53:57,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:53:57,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 69b2602d8eb42fd8a253bad1a4ec74ea; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70525140, jitterRate=0.050906479358673096}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:53:57,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 69b2602d8eb42fd8a253bad1a4ec74ea: Running coprocessor pre-open hook at 1676145237683Writing region info on filesystem at 1676145237683Initializing all the Stores at 1676145237684 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676145237684Cleaning up temporary data from old regions at 1676145237693 (+9 ms)Cleaning up detritus from prior splits at 1676145237694 (+1 ms)Running coprocessor post-open hooks at 1676145237699 (+5 ms)Region opened successfully at 1676145237699 2023-02-11 19:53:57,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea., pid=21, masterSystemTime=1676145237678 2023-02-11 19:53:57,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:53:57,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:53:57,702 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=69b2602d8eb42fd8a253bad1a4ec74ea, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:57,702 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676145237702"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145237702"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145237702"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145237702"}]},"ts":"1676145237702"} 2023-02-11 19:53:57,706 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-11 19:53:57,706 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 69b2602d8eb42fd8a253bad1a4ec74ea, server=jenkins-hbase4.apache.org,45897,1676145215747 in 181 msec 2023-02-11 19:53:57,709 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-02-11 19:53:57,709 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=69b2602d8eb42fd8a253bad1a4ec74ea, ASSIGN in 342 msec 2023-02-11 19:53:57,710 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:53:57,710 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145237710"}]},"ts":"1676145237710"} 2023-02-11 19:53:57,712 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-11 19:53:57,715 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:53:57,717 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 805 msec 2023-02-11 19:53:58,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-11 19:53:58,021 INFO [Listener at localhost/32929] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-02-11 19:53:58,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:53:58,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:58,065 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 19:53:58,065 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:58,066 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 19:53:58,066 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 19:53:58,066 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:58,066 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:58,068 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:58,068 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:58,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:58,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:58,068 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:58,068 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:53:58,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:58,069 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:58,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:53:58,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:58,070 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:58,072 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:58,072 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 19:53:58,072 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:58,073 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 19:53:58,073 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:53:58,073 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:53:58,073 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:53:58,073 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. started... 2023-02-11 19:53:58,074 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 69b2602d8eb42fd8a253bad1a4ec74ea 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-11 19:53:58,518 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130adbc50d469db4fcfa9d4aba0dd018b50 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130adbc50d469db4fcfa9d4aba0dd018b50 2023-02-11 19:53:58,923 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp/family1/1e10404e40a7499099dbbfbbecc9af6e 2023-02-11 19:53:58,930 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp/family1/1e10404e40a7499099dbbfbbecc9af6e as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/1e10404e40a7499099dbbfbbecc9af6e 2023-02-11 19:53:58,936 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/1e10404e40a7499099dbbfbbecc9af6e, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-11 19:53:58,937 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 69b2602d8eb42fd8a253bad1a4ec74ea in 863ms, sequenceid=5, compaction requested=false 2023-02-11 19:53:58,938 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 19:53:58,939 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 69b2602d8eb42fd8a253bad1a4ec74ea: 2023-02-11 19:53:58,939 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:53:58,939 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:53:58,939 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:53:58,939 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:58,939 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 19:53:58,939 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 19:53:59,017 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,017 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:59,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:59,017 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,018 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:53:59,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:59,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:59,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:59,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 19:53:59,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f6f7c56[Count = 0] remaining members to acquire global barrier 2023-02-11 19:53:59,019 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 19:53:59,020 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,086 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,087 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 19:53:59,087 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,087 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:53:59,087 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 19:53:59,087 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:53:59,132 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,132 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 19:53:59,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:59,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:59,132 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:59,133 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 19:53:59,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:59,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:59,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:59,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:53:59,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:53:59,136 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 19:53:59,136 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:53:59,136 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:53:59,136 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,136 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:53:59,209 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,209 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,209 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:59,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:59,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:59,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:59,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,211 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:59,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:59,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:59,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,214 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:59,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,286 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:59,287 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,287 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:59,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 19:53:59,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:53:59,287 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:59,287 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:59,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:59,288 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:53:59,288 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:53:59,287 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,288 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,288 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,288 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,288 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:59,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:59,388 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:53:59,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:53:59,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:53:59,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:53:59,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,398 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 19:53:59,398 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:59,399 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 19:53:59,399 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 19:53:59,400 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,400 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,440 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,440 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:59,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:59,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:59,441 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,441 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:53:59,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,441 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:53:59,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,442 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,442 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 19:53:59,442 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,442 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 19:53:59,442 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:53:59,443 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 19:53:59,444 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:53:59,444 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:53:59,444 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:53:59,444 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. started... 2023-02-11 19:53:59,444 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 69b2602d8eb42fd8a253bad1a4ec74ea 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-11 19:53:59,466 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285fc5fa9bb6af41ff8a4f19df0d8c80b6 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511285fc5fa9bb6af41ff8a4f19df0d8c80b6 2023-02-11 19:53:59,877 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp/family1/f0ec1e39568c456da24d6f5d3384ea03 2023-02-11 19:53:59,885 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp/family1/f0ec1e39568c456da24d6f5d3384ea03 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/f0ec1e39568c456da24d6f5d3384ea03 2023-02-11 19:53:59,891 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/f0ec1e39568c456da24d6f5d3384ea03, entries=1, sequenceid=9, filesize=5.0 K 2023-02-11 19:53:59,893 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 69b2602d8eb42fd8a253bad1a4ec74ea in 449ms, sequenceid=9, compaction requested=false 2023-02-11 19:53:59,893 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 69b2602d8eb42fd8a253bad1a4ec74ea: 2023-02-11 19:53:59,893 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:53:59,893 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:53:59,893 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:53:59,893 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,893 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 19:53:59,893 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 19:53:59,895 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,895 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,895 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:59,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:59,896 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:53:59,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:59,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:59,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:59,899 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 19:53:59,899 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1994f81f[Count = 0] remaining members to acquire global barrier 2023-02-11 19:53:59,899 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 19:53:59,899 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,900 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,900 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 19:53:59,900 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 19:53:59,900 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,901 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:53:59,901 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:53:59,903 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 19:53:59,903 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:59,903 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,903 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 19:53:59,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:59,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:59,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:59,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:59,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:59,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:53:59,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:53:59,907 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 19:53:59,907 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:53:59,907 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:53:59,907 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,907 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:53:59,925 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,925 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:53:59,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:53:59,925 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:59,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:53:59,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:59,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:59,926 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:53:59,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,928 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:53:59,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,956 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,957 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,957 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,956 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:53:59,957 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:53:59,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:53:59,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:53:59,957 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 19:53:59,957 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,957 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:53:59,957 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,957 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:53:59,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:53:59,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:53:59,963 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:53:59,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 19:53:59,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:53:59,963 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:53:59,963 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:00,064 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:00,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:00,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:00,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:00,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,073 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 19:54:00,073 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:00,074 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 19:54:00,074 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:00,074 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,075 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,077 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:00,077 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:00,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:00,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:00,078 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:00,078 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:00,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:00,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,079 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,079 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 19:54:00,079 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,079 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 19:54:00,079 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:00,080 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 19:54:00,080 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:00,080 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:00,080 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:54:00,080 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. started... 2023-02-11 19:54:00,080 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 69b2602d8eb42fd8a253bad1a4ec74ea 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:00,498 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512017e74d38700464838b640c5a02cd3ed11 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512017e74d38700464838b640c5a02cd3ed11 2023-02-11 19:54:00,909 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp/family1/9ae5d294fc15454ba349c96ecd698c21 2023-02-11 19:54:00,916 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp/family1/9ae5d294fc15454ba349c96ecd698c21 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/9ae5d294fc15454ba349c96ecd698c21 2023-02-11 19:54:00,921 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/9ae5d294fc15454ba349c96ecd698c21, entries=1, sequenceid=13, filesize=4.9 K 2023-02-11 19:54:00,922 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 69b2602d8eb42fd8a253bad1a4ec74ea in 842ms, sequenceid=13, compaction requested=true 2023-02-11 19:54:00,923 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 69b2602d8eb42fd8a253bad1a4ec74ea: 2023-02-11 19:54:00,923 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:54:00,923 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:00,923 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:00,923 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:00,923 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 19:54:00,923 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 19:54:00,924 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:00,924 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:00,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:00,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:00,925 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,925 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:00,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:00,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:00,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:00,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:00,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 19:54:00,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c4c462e[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:00,926 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:00,926 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,928 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,928 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:00,928 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 19:54:00,928 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:00,928 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:00,928 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:00,929 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 19:54:00,929 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:00,929 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:00,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:00,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:00,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:00,929 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 19:54:00,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:00,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:00,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:00,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:00,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:00,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:00,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:00,932 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 19:54:00,932 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:00,933 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:00,933 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,933 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:00,936 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,936 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:00,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:00,936 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:00,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:00,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:00,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:00,936 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:00,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:00,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,938 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:00,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:00,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:00,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:00,940 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:00,940 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,940 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,940 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:00,940 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:00,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:00,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:00,940 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:00,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 19:54:00,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:00,941 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:00,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 19:54:00,940 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:00,941 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:00,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:00,942 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:00,942 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:00,942 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,025 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 19:54:01,042 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:01,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:01,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:01,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:01,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,053 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 19:54:01,053 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:01,053 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 19:54:01,053 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:01,054 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,054 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,055 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:01,055 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:01,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:01,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:01,056 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:01,056 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:01,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,056 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:01,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,056 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,057 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 19:54:01,057 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,057 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 19:54:01,057 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:01,057 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 19:54:01,058 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:01,058 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:01,058 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:54:01,058 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. started... 2023-02-11 19:54:01,058 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 69b2602d8eb42fd8a253bad1a4ec74ea 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:01,075 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205afdfc002f8654a45b0c98d45aa5b65e3 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205afdfc002f8654a45b0c98d45aa5b65e3 2023-02-11 19:54:01,481 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp/family1/ce793903e5a441219256401131405bee 2023-02-11 19:54:01,488 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp/family1/ce793903e5a441219256401131405bee as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/ce793903e5a441219256401131405bee 2023-02-11 19:54:01,492 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/ce793903e5a441219256401131405bee, entries=1, sequenceid=17, filesize=4.9 K 2023-02-11 19:54:01,494 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 69b2602d8eb42fd8a253bad1a4ec74ea in 436ms, sequenceid=17, compaction requested=true 2023-02-11 19:54:01,494 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 69b2602d8eb42fd8a253bad1a4ec74ea: 2023-02-11 19:54:01,494 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:54:01,494 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:01,494 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:01,494 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:01,494 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 19:54:01,494 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 19:54:01,495 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:01,495 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:01,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:01,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:01,496 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,496 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:01,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:01,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:01,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:01,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:01,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 19:54:01,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5cdfa80d[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:01,497 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:01,497 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,499 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,499 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:01,499 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 19:54:01,499 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:01,500 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:01,500 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:01,501 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:01,501 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 19:54:01,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:01,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:01,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:01,501 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:01,501 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 19:54:01,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:01,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:01,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:01,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:01,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:01,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:01,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:01,504 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 19:54:01,504 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:01,504 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:01,504 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,504 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:01,508 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,508 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:01,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:01,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,508 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:01,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:01,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:01,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:01,509 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:01,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:01,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,510 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:01,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:01,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:01,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:01,513 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:01,513 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,513 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:01,513 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:01,513 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:01,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 19:54:01,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:01,513 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:01,513 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:01,513 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:01,513 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,513 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 19:54:01,514 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:01,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:01,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:01,514 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:01,614 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:01,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:01,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:01,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:01,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,622 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 19:54:01,622 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:01,623 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 19:54:01,623 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:01,623 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,623 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,625 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:01,625 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:01,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:01,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:01,626 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:01,626 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:01,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,626 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:01,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,627 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,627 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 19:54:01,627 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:01,627 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 19:54:01,627 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:01,627 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 19:54:01,628 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:01,628 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:01,628 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:54:01,628 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. started... 2023-02-11 19:54:01,628 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 69b2602d8eb42fd8a253bad1a4ec74ea 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:02,046 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228389e6da50d84432082da9141775f3491 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228389e6da50d84432082da9141775f3491 2023-02-11 19:54:02,453 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp/family1/eb923f3e713f489a835503e79a0138b8 2023-02-11 19:54:02,460 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp/family1/eb923f3e713f489a835503e79a0138b8 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/eb923f3e713f489a835503e79a0138b8 2023-02-11 19:54:02,466 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/eb923f3e713f489a835503e79a0138b8, entries=1, sequenceid=21, filesize=4.9 K 2023-02-11 19:54:02,467 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 69b2602d8eb42fd8a253bad1a4ec74ea in 839ms, sequenceid=21, compaction requested=true 2023-02-11 19:54:02,467 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 69b2602d8eb42fd8a253bad1a4ec74ea: 2023-02-11 19:54:02,467 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:54:02,467 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:02,467 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:02,467 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:02,467 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 19:54:02,467 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 19:54:02,469 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,469 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:02,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:02,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:02,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:02,469 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,469 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:02,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:02,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:02,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:02,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:02,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 19:54:02,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38b6f20c[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:02,471 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:02,471 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,472 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,472 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:02,472 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 19:54:02,472 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:02,472 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:02,472 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:02,475 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 19:54:02,475 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:02,475 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:02,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:02,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:02,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:02,475 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 19:54:02,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:02,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:02,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:02,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:02,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:02,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:02,478 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:02,478 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 19:54:02,478 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:02,478 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:02,478 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,478 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:02,484 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,484 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:02,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:02,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,484 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:02,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:02,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:02,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:02,485 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:02,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:02,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,486 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:02,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:02,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:02,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:02,488 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:02,488 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:02,488 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:02,488 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:02,488 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:02,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 19:54:02,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:02,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:02,488 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 19:54:02,488 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,490 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:02,490 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,490 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,490 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:02,490 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:02,490 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:02,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:02,590 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:02,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:02,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:02,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:02,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,597 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 19:54:02,597 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:02,598 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 19:54:02,598 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:02,598 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,598 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,600 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:02,600 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:02,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:02,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:02,600 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:02,600 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:02,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:02,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,601 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,601 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 19:54:02,602 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:02,602 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 19:54:02,602 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:02,602 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 19:54:02,603 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:02,603 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:02,603 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:54:02,603 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. started... 2023-02-11 19:54:02,603 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 69b2602d8eb42fd8a253bad1a4ec74ea 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:02,619 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512317daef530c4f94c8cada6944521dac2dc to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512317daef530c4f94c8cada6944521dac2dc 2023-02-11 19:54:03,025 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp/family1/38a81931a1fc4fc7876e5016a1717bb9 2023-02-11 19:54:03,033 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp/family1/38a81931a1fc4fc7876e5016a1717bb9 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/38a81931a1fc4fc7876e5016a1717bb9 2023-02-11 19:54:03,040 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/38a81931a1fc4fc7876e5016a1717bb9, entries=1, sequenceid=25, filesize=4.9 K 2023-02-11 19:54:03,041 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 69b2602d8eb42fd8a253bad1a4ec74ea in 438ms, sequenceid=25, compaction requested=true 2023-02-11 19:54:03,041 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 69b2602d8eb42fd8a253bad1a4ec74ea: 2023-02-11 19:54:03,041 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:54:03,041 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:03,042 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:03,042 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,042 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 19:54:03,042 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 19:54:03,044 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,044 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:03,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:03,044 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,044 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:03,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:03,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:03,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:03,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 19:54:03,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6dca105[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:03,046 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:03,046 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,049 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,049 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:03,049 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 19:54:03,049 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:03,050 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,050 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:03,058 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 19:54:03,058 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,058 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:03,058 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 19:54:03,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:03,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:03,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:03,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:03,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:03,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:03,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:03,062 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 19:54:03,062 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:03,062 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:03,062 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,062 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:03,064 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,064 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:03,064 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:03,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:03,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:03,065 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:03,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:03,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:03,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,067 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:03,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,069 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,069 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:03,069 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,069 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:03,069 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:03,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 19:54:03,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:03,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:03,069 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:03,069 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,070 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,070 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,070 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:03,070 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 19:54:03,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:03,071 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:03,071 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:03,171 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:03,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:03,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:03,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:03,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,186 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 19:54:03,186 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:03,187 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 19:54:03,187 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:03,187 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,187 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,189 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:03,189 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:03,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:03,189 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,190 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:03,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,190 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:03,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,191 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,192 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 19:54:03,192 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,192 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 19:54:03,192 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:03,197 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 19:54:03,200 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:03,200 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:03,200 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:54:03,200 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. started... 2023-02-11 19:54:03,200 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 69b2602d8eb42fd8a253bad1a4ec74ea 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:03,619 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f11b79e6b36246849a9ac707824857dd to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101f11b79e6b36246849a9ac707824857dd 2023-02-11 19:54:03,626 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp/family1/6899a5aefb244a98825ac5a581860c2d 2023-02-11 19:54:03,632 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp/family1/6899a5aefb244a98825ac5a581860c2d as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/6899a5aefb244a98825ac5a581860c2d 2023-02-11 19:54:03,639 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/6899a5aefb244a98825ac5a581860c2d, entries=1, sequenceid=29, filesize=4.9 K 2023-02-11 19:54:03,640 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 69b2602d8eb42fd8a253bad1a4ec74ea in 440ms, sequenceid=29, compaction requested=true 2023-02-11 19:54:03,640 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 69b2602d8eb42fd8a253bad1a4ec74ea: 2023-02-11 19:54:03,640 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:54:03,640 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:03,640 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:03,640 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,640 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 19:54:03,641 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 19:54:03,642 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,642 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:03,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:03,643 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:03,643 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:03,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:03,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:03,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 19:54:03,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8afeac6[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:03,644 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:03,644 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,646 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,646 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:03,646 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 19:54:03,646 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:03,646 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,646 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:03,648 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,648 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 19:54:03,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:03,648 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:03,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:03,648 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 19:54:03,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:03,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:03,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:03,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:03,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:03,651 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 19:54:03,651 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:03,651 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:03,651 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,651 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:03,653 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,653 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:03,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:03,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,653 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:03,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:03,653 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:03,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:03,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:03,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,655 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:03,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,657 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,657 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:03,657 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:03,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:03,657 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:03,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 19:54:03,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 19:54:03,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:03,657 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:03,657 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:03,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:03,657 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,658 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:03,658 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:03,658 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,658 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,658 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,758 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:03,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:03,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:03,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:03,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,768 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 19:54:03,768 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:03,774 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 19:54:03,774 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:03,775 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,775 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,776 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:03,776 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:03,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:03,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,777 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:03,777 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:03,777 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:03,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,778 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,778 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 19:54:03,778 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:03,779 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 19:54:03,780 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:03,780 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 19:54:03,780 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:03,780 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:03,780 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:54:03,780 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. started... 2023-02-11 19:54:03,781 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 69b2602d8eb42fd8a253bad1a4ec74ea 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:03,798 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036adbab4484014feaba24d0056d5cd888 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601036adbab4484014feaba24d0056d5cd888 2023-02-11 19:54:04,205 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp/family1/f282f9f94e364216a6fbfac10986ef2a 2023-02-11 19:54:04,212 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp/family1/f282f9f94e364216a6fbfac10986ef2a as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/f282f9f94e364216a6fbfac10986ef2a 2023-02-11 19:54:04,218 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/f282f9f94e364216a6fbfac10986ef2a, entries=1, sequenceid=33, filesize=4.9 K 2023-02-11 19:54:04,219 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 69b2602d8eb42fd8a253bad1a4ec74ea in 438ms, sequenceid=33, compaction requested=true 2023-02-11 19:54:04,219 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 69b2602d8eb42fd8a253bad1a4ec74ea: 2023-02-11 19:54:04,219 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:54:04,219 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:04,219 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:04,219 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,219 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 19:54:04,219 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 19:54:04,221 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,221 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:04,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:04,222 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,222 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:04,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:04,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:04,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:04,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 19:54:04,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2911b41e[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:04,223 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:04,223 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,224 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,224 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:04,224 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,224 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:04,224 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 19:54:04,224 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:04,229 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 19:54:04,229 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:04,229 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,229 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 19:54:04,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:04,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:04,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:04,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:04,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:04,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:04,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:04,232 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 19:54:04,232 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:04,232 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:04,232 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,232 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:04,234 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,234 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,234 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:04,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:04,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:04,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,234 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:04,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:04,236 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:04,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,238 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,238 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,238 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:04,238 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,238 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:04,238 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 19:54:04,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:04,238 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:04,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:04,239 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 19:54:04,239 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,239 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:04,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:04,239 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:04,239 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,240 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:04,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:04,340 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:04,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:04,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:04,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:04,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,347 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 19:54:04,347 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:04,348 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 19:54:04,348 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:04,348 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,349 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,351 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:04,351 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:04,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:04,352 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,352 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:04,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:04,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,353 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,353 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 19:54:04,353 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,353 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 19:54:04,353 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:04,353 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 19:54:04,354 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:04,354 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:04,354 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:54:04,354 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. started... 2023-02-11 19:54:04,354 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 69b2602d8eb42fd8a253bad1a4ec74ea 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:04,772 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509078672d049347a435181ca449f89fe6de1 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201509078672d049347a435181ca449f89fe6de1 2023-02-11 19:54:04,779 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp/family1/9b989571e9c94a008bdcb6149ea2f419 2023-02-11 19:54:04,786 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp/family1/9b989571e9c94a008bdcb6149ea2f419 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/9b989571e9c94a008bdcb6149ea2f419 2023-02-11 19:54:04,792 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/9b989571e9c94a008bdcb6149ea2f419, entries=1, sequenceid=37, filesize=4.9 K 2023-02-11 19:54:04,794 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 69b2602d8eb42fd8a253bad1a4ec74ea in 440ms, sequenceid=37, compaction requested=true 2023-02-11 19:54:04,794 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 69b2602d8eb42fd8a253bad1a4ec74ea: 2023-02-11 19:54:04,794 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:54:04,794 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:04,794 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:04,794 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,794 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 19:54:04,794 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 19:54:04,797 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,797 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:04,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:04,798 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,798 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:04,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 19:54:04,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26b805a2[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:04,799 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:04,799 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,801 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,801 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:04,801 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 19:54:04,801 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,801 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:04,801 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:04,803 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,803 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 19:54:04,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:04,803 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:04,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:04,804 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 19:54:04,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:04,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:04,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:04,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:04,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:04,806 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 19:54:04,806 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:04,806 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:04,806 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,806 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:04,808 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,808 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:04,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:04,808 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:04,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:04,809 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:04,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:04,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:04,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,810 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:04,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,813 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,813 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:04,813 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:04,813 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:04,813 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:04,813 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:04,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 19:54:04,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:04,813 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:04,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:04,814 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,814 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,814 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,814 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:04,814 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:04,915 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:04,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:04,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:04,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:04,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,922 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 19:54:04,922 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:04,923 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 19:54:04,923 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:04,924 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,924 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,925 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:04,925 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:04,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:04,925 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:04,925 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:04,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:04,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,926 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,926 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 19:54:04,926 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:04,926 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 19:54:04,927 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:04,928 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 19:54:04,928 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:04,928 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:04,928 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:54:04,928 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. started... 2023-02-11 19:54:04,928 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 69b2602d8eb42fd8a253bad1a4ec74ea 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:05,353 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511202c89bb55fea34137aa9773e28c20aad7 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511202c89bb55fea34137aa9773e28c20aad7 2023-02-11 19:54:05,760 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp/family1/dfa6497840914f058b5e8c946f18bdaa 2023-02-11 19:54:05,766 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp/family1/dfa6497840914f058b5e8c946f18bdaa as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/dfa6497840914f058b5e8c946f18bdaa 2023-02-11 19:54:05,771 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/dfa6497840914f058b5e8c946f18bdaa, entries=1, sequenceid=41, filesize=4.9 K 2023-02-11 19:54:05,772 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 69b2602d8eb42fd8a253bad1a4ec74ea in 844ms, sequenceid=41, compaction requested=true 2023-02-11 19:54:05,772 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 69b2602d8eb42fd8a253bad1a4ec74ea: 2023-02-11 19:54:05,772 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:54:05,772 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:05,772 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:05,772 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:05,772 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 19:54:05,772 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 19:54:05,774 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:05,774 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:05,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:05,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:05,774 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,774 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:05,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:05,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:05,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:05,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:05,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 19:54:05,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@458f4cf9[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:05,776 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:05,776 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,778 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,779 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:05,779 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:05,779 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:05,779 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 19:54:05,779 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:05,780 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 19:54:05,780 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:05,780 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:05,780 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 19:54:05,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:05,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:05,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:05,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:05,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:05,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:05,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:05,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:05,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:05,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:05,783 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 19:54:05,783 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:05,783 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:05,783 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,783 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:05,785 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,785 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:05,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:05,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,785 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:05,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:05,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:05,785 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:05,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:05,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:05,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,787 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:05,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:05,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:05,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:05,789 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:05,789 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,789 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:05,789 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:05,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 19:54:05,789 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:05,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:05,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:05,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 19:54:05,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:05,789 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,791 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:05,791 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,791 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,791 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:05,791 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:05,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:05,791 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:05,891 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:05,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:05,894 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40445] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-02-11 19:54:05,896 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 19:54:05,896 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 19:54:05,898 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676145845898 2023-02-11 19:54:05,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:54:05,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 19:54:05,900 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-11 19:54:05,900 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 19:54:05,901 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] zookeeper.ReadOnlyZKClient(139): Connect 0x4cf470c6 to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:54:05,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4860380a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:54:05,906 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 19:54:06,752 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030dc8e06385a4405995c26bf61397216f to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601030dc8e06385a4405995c26bf61397216f 2023-02-11 19:54:06,753 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 19:54:06,767 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:54:06,768 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50316, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:54:06,775 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:54:06,776 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36890, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:54:06,787 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/310bcfceeaa04eefa8d0d6454df8d7af first=Optional[r5] last=Optional[r6] 2023-02-11 19:54:06,787 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/310bcfceeaa04eefa8d0d6454df8d7af}] 2023-02-11 19:54:06,792 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/310bcfceeaa04eefa8d0d6454df8d7af for inclusion in 69b2602d8eb42fd8a253bad1a4ec74ea/family1 2023-02-11 19:54:06,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-11 19:54:06,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 19:54:06,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 69b2602d8eb42fd8a253bad1a4ec74ea: 2023-02-11 19:54:06,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/310bcfceeaa04eefa8d0d6454df8d7af to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1j6lp6icupoavca6cui5pn9bihn280peo82iohan8ss8f5qc8nd9h6difmnf5loi/family1/310bcfceeaa04eefa8d0d6454df8d7af 2023-02-11 19:54:06,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1j6lp6icupoavca6cui5pn9bihn280peo82iohan8ss8f5qc8nd9h6difmnf5loi/family1/310bcfceeaa04eefa8d0d6454df8d7af as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/675222885fbf4e4ebe8cf376284c5cfa_SeqId_44_ 2023-02-11 19:54:06,799 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1j6lp6icupoavca6cui5pn9bihn280peo82iohan8ss8f5qc8nd9h6difmnf5loi/family1/310bcfceeaa04eefa8d0d6454df8d7af into 69b2602d8eb42fd8a253bad1a4ec74ea/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/675222885fbf4e4ebe8cf376284c5cfa_SeqId_44_ - updating store file list. 2023-02-11 19:54:06,804 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/675222885fbf4e4ebe8cf376284c5cfa_SeqId_44_ into 69b2602d8eb42fd8a253bad1a4ec74ea/family1 2023-02-11 19:54:06,804 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1j6lp6icupoavca6cui5pn9bihn280peo82iohan8ss8f5qc8nd9h6difmnf5loi/family1/310bcfceeaa04eefa8d0d6454df8d7af into 69b2602d8eb42fd8a253bad1a4ec74ea/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/675222885fbf4e4ebe8cf376284c5cfa_SeqId_44_) 2023-02-11 19:54:06,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1j6lp6icupoavca6cui5pn9bihn280peo82iohan8ss8f5qc8nd9h6difmnf5loi/family1/310bcfceeaa04eefa8d0d6454df8d7af 2023-02-11 19:54:06,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-11 19:54:06,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-11 19:54:06,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(1912): 69b2602d8eb42fd8a253bad1a4ec74ea/family1 is initiating minor compaction 2023-02-11 19:54:06,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@676f3bef; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:54:06,809 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 69b2602d8eb42fd8a253bad1a4ec74ea/family1 in testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:54:06,810 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/f0ec1e39568c456da24d6f5d3384ea03, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/9ae5d294fc15454ba349c96ecd698c21, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/ce793903e5a441219256401131405bee, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/eb923f3e713f489a835503e79a0138b8, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/38a81931a1fc4fc7876e5016a1717bb9, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/6899a5aefb244a98825ac5a581860c2d, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/f282f9f94e364216a6fbfac10986ef2a, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/9b989571e9c94a008bdcb6149ea2f419, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/dfa6497840914f058b5e8c946f18bdaa, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/675222885fbf4e4ebe8cf376284c5cfa_SeqId_44_] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp, totalSize=49.7 K 2023-02-11 19:54:06,810 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting f0ec1e39568c456da24d6f5d3384ea03, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 19:54:06,810 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 9ae5d294fc15454ba349c96ecd698c21, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 19:54:06,810 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting ce793903e5a441219256401131405bee, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-11 19:54:06,810 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting eb923f3e713f489a835503e79a0138b8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-11 19:54:06,810 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 38a81931a1fc4fc7876e5016a1717bb9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-11 19:54:06,810 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 6899a5aefb244a98825ac5a581860c2d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-11 19:54:06,810 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting f282f9f94e364216a6fbfac10986ef2a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-11 19:54:06,810 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 9b989571e9c94a008bdcb6149ea2f419, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-11 19:54:06,810 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting dfa6497840914f058b5e8c946f18bdaa, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-11 19:54:06,810 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 675222885fbf4e4ebe8cf376284c5cfa_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-11 19:54:06,811 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 19:54:06,812 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:54:06,814 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101f11b79e6b36246849a9ac707824857dd to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101f11b79e6b36246849a9ac707824857dd 2023-02-11 19:54:06,816 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601036adbab4484014feaba24d0056d5cd888 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601036adbab4484014feaba24d0056d5cd888 2023-02-11 19:54:06,816 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-11 19:54:06,816 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-11 19:54:06,816 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 19:54:06,816 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 19:54:06,880 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] throttle.PressureAwareThroughputController(145): 69b2602d8eb42fd8a253bad1a4ec74ea#family1#compaction#22 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:54:06,907 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp/family1/3c74ee13377e4244a5be2c0d9cb75d39 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/3c74ee13377e4244a5be2c0d9cb75d39 2023-02-11 19:54:06,914 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 69b2602d8eb42fd8a253bad1a4ec74ea/family1 of 69b2602d8eb42fd8a253bad1a4ec74ea into 3c74ee13377e4244a5be2c0d9cb75d39(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 19:54:06,914 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 69b2602d8eb42fd8a253bad1a4ec74ea: 2023-02-11 19:54:06,914 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1676145246809; duration=0sec 2023-02-11 19:54:06,915 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:54:06,933 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/f0ec1e39568c456da24d6f5d3384ea03, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/9ae5d294fc15454ba349c96ecd698c21, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/ce793903e5a441219256401131405bee, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/eb923f3e713f489a835503e79a0138b8, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/38a81931a1fc4fc7876e5016a1717bb9, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/6899a5aefb244a98825ac5a581860c2d, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/f282f9f94e364216a6fbfac10986ef2a, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/9b989571e9c94a008bdcb6149ea2f419, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/dfa6497840914f058b5e8c946f18bdaa, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/675222885fbf4e4ebe8cf376284c5cfa_SeqId_44_] to archive 2023-02-11 19:54:06,934 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:54:06,936 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/f0ec1e39568c456da24d6f5d3384ea03 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/f0ec1e39568c456da24d6f5d3384ea03 2023-02-11 19:54:06,938 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/9ae5d294fc15454ba349c96ecd698c21 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/9ae5d294fc15454ba349c96ecd698c21 2023-02-11 19:54:06,939 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/ce793903e5a441219256401131405bee to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/ce793903e5a441219256401131405bee 2023-02-11 19:54:06,940 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/eb923f3e713f489a835503e79a0138b8 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/eb923f3e713f489a835503e79a0138b8 2023-02-11 19:54:06,941 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/38a81931a1fc4fc7876e5016a1717bb9 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/38a81931a1fc4fc7876e5016a1717bb9 2023-02-11 19:54:06,943 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/6899a5aefb244a98825ac5a581860c2d to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/6899a5aefb244a98825ac5a581860c2d 2023-02-11 19:54:06,944 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/f282f9f94e364216a6fbfac10986ef2a to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/f282f9f94e364216a6fbfac10986ef2a 2023-02-11 19:54:06,946 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/9b989571e9c94a008bdcb6149ea2f419 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/9b989571e9c94a008bdcb6149ea2f419 2023-02-11 19:54:06,947 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/dfa6497840914f058b5e8c946f18bdaa to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/dfa6497840914f058b5e8c946f18bdaa 2023-02-11 19:54:06,948 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/675222885fbf4e4ebe8cf376284c5cfa_SeqId_44_ to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/675222885fbf4e4ebe8cf376284c5cfa_SeqId_44_ 2023-02-11 19:54:07,703 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512311dca7c13622d42969442a46f2ccf8455 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512311dca7c13622d42969442a46f2ccf8455 2023-02-11 19:54:07,704 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 19:54:07,730 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/ff6c28c182d44608bcbfff787fa7a1d7 first=Optional[r1] last=Optional[r4] 2023-02-11 19:54:07,731 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/ff6c28c182d44608bcbfff787fa7a1d7}] 2023-02-11 19:54:07,733 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/ff6c28c182d44608bcbfff787fa7a1d7 for inclusion in 69b2602d8eb42fd8a253bad1a4ec74ea/family1 2023-02-11 19:54:07,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-11 19:54:07,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 19:54:07,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 69b2602d8eb42fd8a253bad1a4ec74ea: 2023-02-11 19:54:07,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/ff6c28c182d44608bcbfff787fa7a1d7 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1d45tcgn9kln45qauks5kcqfn1lt8h6upkd8fqdon7mh6uiqadvj84ph79d5e6uo/family1/ff6c28c182d44608bcbfff787fa7a1d7 2023-02-11 19:54:07,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1d45tcgn9kln45qauks5kcqfn1lt8h6upkd8fqdon7mh6uiqadvj84ph79d5e6uo/family1/ff6c28c182d44608bcbfff787fa7a1d7 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/5daa311ce028450b9686d79b91221915_SeqId_47_ 2023-02-11 19:54:07,742 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1d45tcgn9kln45qauks5kcqfn1lt8h6upkd8fqdon7mh6uiqadvj84ph79d5e6uo/family1/ff6c28c182d44608bcbfff787fa7a1d7 into 69b2602d8eb42fd8a253bad1a4ec74ea/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/5daa311ce028450b9686d79b91221915_SeqId_47_ - updating store file list. 2023-02-11 19:54:07,747 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/5daa311ce028450b9686d79b91221915_SeqId_47_ into 69b2602d8eb42fd8a253bad1a4ec74ea/family1 2023-02-11 19:54:07,747 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1d45tcgn9kln45qauks5kcqfn1lt8h6upkd8fqdon7mh6uiqadvj84ph79d5e6uo/family1/ff6c28c182d44608bcbfff787fa7a1d7 into 69b2602d8eb42fd8a253bad1a4ec74ea/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/5daa311ce028450b9686d79b91221915_SeqId_47_) 2023-02-11 19:54:07,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1d45tcgn9kln45qauks5kcqfn1lt8h6upkd8fqdon7mh6uiqadvj84ph79d5e6uo/family1/ff6c28c182d44608bcbfff787fa7a1d7 2023-02-11 19:54:07,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-11 19:54:07,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-11 19:54:07,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(1912): 69b2602d8eb42fd8a253bad1a4ec74ea/family1 is initiating minor compaction (all files) 2023-02-11 19:54:07,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@81f2228; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:54:07,749 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 69b2602d8eb42fd8a253bad1a4ec74ea/family1 in testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:54:07,749 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/1e10404e40a7499099dbbfbbecc9af6e, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/3c74ee13377e4244a5be2c0d9cb75d39, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/5daa311ce028450b9686d79b91221915_SeqId_47_] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp, totalSize=178.1 K 2023-02-11 19:54:07,750 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 1e10404e40a7499099dbbfbbecc9af6e, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878840136 2023-02-11 19:54:07,751 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 3c74ee13377e4244a5be2c0d9cb75d39, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621240136 2023-02-11 19:54:07,751 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 5daa311ce028450b9686d79b91221915_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965240136 2023-02-11 19:54:07,752 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 19:54:07,752 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:54:07,754 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512017e74d38700464838b640c5a02cd3ed11 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512017e74d38700464838b640c5a02cd3ed11 2023-02-11 19:54:07,756 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205afdfc002f8654a45b0c98d45aa5b65e3 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205afdfc002f8654a45b0c98d45aa5b65e3 2023-02-11 19:54:07,758 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228389e6da50d84432082da9141775f3491 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228389e6da50d84432082da9141775f3491 2023-02-11 19:54:07,760 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512317daef530c4f94c8cada6944521dac2dc to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512317daef530c4f94c8cada6944521dac2dc 2023-02-11 19:54:07,760 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-11 19:54:07,760 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-11 19:54:07,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 19:54:07,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 19:54:07,771 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] throttle.PressureAwareThroughputController(145): 69b2602d8eb42fd8a253bad1a4ec74ea#family1#compaction#23 average throughput is 15.56 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:54:07,836 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:54:07,836 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e1135e0 to 127.0.0.1:64025 2023-02-11 19:54:07,836 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:54:07,853 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:54:07,853 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48995002 to 127.0.0.1:64025 2023-02-11 19:54:07,853 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:54:08,249 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/.tmp/family1/16e4a18307304fd9852a3a1107fbb1a8 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/16e4a18307304fd9852a3a1107fbb1a8 2023-02-11 19:54:08,255 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 69b2602d8eb42fd8a253bad1a4ec74ea/family1 of 69b2602d8eb42fd8a253bad1a4ec74ea into 16e4a18307304fd9852a3a1107fbb1a8(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 19:54:08,255 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 69b2602d8eb42fd8a253bad1a4ec74ea: 2023-02-11 19:54:08,255 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1676145247749; duration=0sec 2023-02-11 19:54:08,255 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:54:08,291 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130ccc7260bed8545259ae18a579a4acdc4 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130ccc7260bed8545259ae18a579a4acdc4 2023-02-11 19:54:08,292 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 19:54:08,331 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/1e10404e40a7499099dbbfbbecc9af6e, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/3c74ee13377e4244a5be2c0d9cb75d39, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/5daa311ce028450b9686d79b91221915_SeqId_47_] to archive 2023-02-11 19:54:08,332 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:54:08,336 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/1e10404e40a7499099dbbfbbecc9af6e to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/1e10404e40a7499099dbbfbbecc9af6e 2023-02-11 19:54:08,339 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/3c74ee13377e4244a5be2c0d9cb75d39 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/3c74ee13377e4244a5be2c0d9cb75d39 2023-02-11 19:54:08,340 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f546c886a4aa470d8b8c126d1bf1fbf9 first=Optional[r00] last=Optional[r8] 2023-02-11 19:54:08,341 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f546c886a4aa470d8b8c126d1bf1fbf9}] 2023-02-11 19:54:08,342 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/5daa311ce028450b9686d79b91221915_SeqId_47_ to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/5daa311ce028450b9686d79b91221915_SeqId_47_ 2023-02-11 19:54:08,343 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f546c886a4aa470d8b8c126d1bf1fbf9 for inclusion in 69b2602d8eb42fd8a253bad1a4ec74ea/family1 2023-02-11 19:54:08,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-11 19:54:08,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 19:54:08,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 69b2602d8eb42fd8a253bad1a4ec74ea: 2023-02-11 19:54:08,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f546c886a4aa470d8b8c126d1bf1fbf9 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithMonthlyPolicy__b9h3q7moem8ol95hf3ro7a86r52lfjaa9d6a684to9ea8avucejnsnfs48qies8v/family1/f546c886a4aa470d8b8c126d1bf1fbf9 2023-02-11 19:54:08,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithMonthlyPolicy__b9h3q7moem8ol95hf3ro7a86r52lfjaa9d6a684to9ea8avucejnsnfs48qies8v/family1/f546c886a4aa470d8b8c126d1bf1fbf9 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/e03b9694ac874f8c9d0f22c007469517_SeqId_50_ 2023-02-11 19:54:08,361 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithMonthlyPolicy__b9h3q7moem8ol95hf3ro7a86r52lfjaa9d6a684to9ea8avucejnsnfs48qies8v/family1/f546c886a4aa470d8b8c126d1bf1fbf9 into 69b2602d8eb42fd8a253bad1a4ec74ea/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/e03b9694ac874f8c9d0f22c007469517_SeqId_50_ - updating store file list. 2023-02-11 19:54:08,367 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/e03b9694ac874f8c9d0f22c007469517_SeqId_50_ into 69b2602d8eb42fd8a253bad1a4ec74ea/family1 2023-02-11 19:54:08,367 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithMonthlyPolicy__b9h3q7moem8ol95hf3ro7a86r52lfjaa9d6a684to9ea8avucejnsnfs48qies8v/family1/f546c886a4aa470d8b8c126d1bf1fbf9 into 69b2602d8eb42fd8a253bad1a4ec74ea/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/family1/e03b9694ac874f8c9d0f22c007469517_SeqId_50_) 2023-02-11 19:54:08,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithMonthlyPolicy__b9h3q7moem8ol95hf3ro7a86r52lfjaa9d6a684to9ea8avucejnsnfs48qies8v/family1/f546c886a4aa470d8b8c126d1bf1fbf9 2023-02-11 19:54:08,371 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 19:54:08,372 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:54:08,374 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511202c89bb55fea34137aa9773e28c20aad7 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511202c89bb55fea34137aa9773e28c20aad7 2023-02-11 19:54:08,376 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511285fc5fa9bb6af41ff8a4f19df0d8c80b6 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511285fc5fa9bb6af41ff8a4f19df0d8c80b6 2023-02-11 19:54:08,378 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130adbc50d469db4fcfa9d4aba0dd018b50 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130adbc50d469db4fcfa9d4aba0dd018b50 2023-02-11 19:54:08,378 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-11 19:54:08,378 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-11 19:54:08,378 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 19:54:08,378 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 19:54:08,378 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 19:54:08,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 19:54:08,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:54:08,380 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 19:54:08,382 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.4860 sec 2023-02-11 19:54:08,532 INFO [Listener at localhost/32929] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=249 (was 246) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64025@0x4cf470c6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/679487775.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:52066 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:52108 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3bf757a8-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:52186 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1611553884_15 at /127.0.0.1:52134 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64025@0x4cf470c6-SendThread(127.0.0.1:64025) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:52138 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:52154 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1611553884_15 at /127.0.0.1:52056 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3bf757a8-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3bf757a8-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64025@0x4cf470c6-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:52236 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/cluster_675f2e08-3f55-fd57-3b4a-b26ff360a207/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3bf757a8-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:52284 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/cluster_675f2e08-3f55-fd57-3b4a-b26ff360a207/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:52170 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3bf757a8-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:52092 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3bf757a8-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:52230 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3bf757a8-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:52164 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:52222 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:52282 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:46616 [Waiting for operation #30] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-557276000_15 at /127.0.0.1:52100 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=592 (was 590) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=437 (was 306) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3897 (was 4570) 2023-02-11 19:54:08,549 INFO [Listener at localhost/32929] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=249, OpenFileDescriptor=592, MaxFileDescriptor=60000, SystemLoadAverage=437, ProcessCount=168, AvailableMemoryMB=3896 2023-02-11 19:54:08,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-11 19:54:08,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:08,556 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:54:08,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-02-11 19:54:08,557 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:54:08,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-11 19:54:08,568 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413 2023-02-11 19:54:08,569 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413 empty. 2023-02-11 19:54:08,570 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413 2023-02-11 19:54:08,570 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-02-11 19:54:08,592 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-11 19:54:08,596 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 22951ff8096602d1969aa6daaf2e1413, NAME => 'testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp 2023-02-11 19:54:08,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-11 19:54:08,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-11 19:54:09,007 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:54:09,008 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing 22951ff8096602d1969aa6daaf2e1413, disabling compactions & flushes 2023-02-11 19:54:09,008 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:09,008 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:09,008 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. after waiting 0 ms 2023-02-11 19:54:09,008 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:09,008 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:09,008 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 22951ff8096602d1969aa6daaf2e1413: Waiting for close lock at 1676145249008Disabling compacts and flushes for region at 1676145249008Disabling writes for close at 1676145249008Writing region close event to WAL at 1676145249008Closed at 1676145249008 2023-02-11 19:54:09,011 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:54:09,012 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676145249012"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145249012"}]},"ts":"1676145249012"} 2023-02-11 19:54:09,014 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 19:54:09,015 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:54:09,015 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145249015"}]},"ts":"1676145249015"} 2023-02-11 19:54:09,017 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-11 19:54:09,023 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=22951ff8096602d1969aa6daaf2e1413, ASSIGN}] 2023-02-11 19:54:09,025 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=22951ff8096602d1969aa6daaf2e1413, ASSIGN 2023-02-11 19:54:09,026 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=22951ff8096602d1969aa6daaf2e1413, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=false 2023-02-11 19:54:09,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-11 19:54:09,177 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=22951ff8096602d1969aa6daaf2e1413, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:09,178 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676145249177"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145249177"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145249177"}]},"ts":"1676145249177"} 2023-02-11 19:54:09,181 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 22951ff8096602d1969aa6daaf2e1413, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:54:09,338 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:09,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 22951ff8096602d1969aa6daaf2e1413, NAME => 'testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:54:09,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 22951ff8096602d1969aa6daaf2e1413 2023-02-11 19:54:09,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:54:09,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 22951ff8096602d1969aa6daaf2e1413 2023-02-11 19:54:09,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 22951ff8096602d1969aa6daaf2e1413 2023-02-11 19:54:09,341 INFO [StoreOpener-22951ff8096602d1969aa6daaf2e1413-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 22951ff8096602d1969aa6daaf2e1413 2023-02-11 19:54:09,344 DEBUG [StoreOpener-22951ff8096602d1969aa6daaf2e1413-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1 2023-02-11 19:54:09,345 DEBUG [StoreOpener-22951ff8096602d1969aa6daaf2e1413-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1 2023-02-11 19:54:09,345 INFO [StoreOpener-22951ff8096602d1969aa6daaf2e1413-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 22951ff8096602d1969aa6daaf2e1413 columnFamilyName family1 2023-02-11 19:54:09,347 INFO [StoreOpener-22951ff8096602d1969aa6daaf2e1413-1] regionserver.HStore(310): Store=22951ff8096602d1969aa6daaf2e1413/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:54:09,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413 2023-02-11 19:54:09,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413 2023-02-11 19:54:09,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 22951ff8096602d1969aa6daaf2e1413 2023-02-11 19:54:09,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:54:09,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 22951ff8096602d1969aa6daaf2e1413; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68693561, jitterRate=0.0236138254404068}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:54:09,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 22951ff8096602d1969aa6daaf2e1413: Running coprocessor pre-open hook at 1676145249339Writing region info on filesystem at 1676145249339Initializing all the Stores at 1676145249341 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676145249341Cleaning up temporary data from old regions at 1676145249350 (+9 ms)Cleaning up detritus from prior splits at 1676145249350Running coprocessor post-open hooks at 1676145249362 (+12 ms)Region opened successfully at 1676145249362 2023-02-11 19:54:09,363 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413., pid=25, masterSystemTime=1676145249333 2023-02-11 19:54:09,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:09,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:09,367 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=22951ff8096602d1969aa6daaf2e1413, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:09,367 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676145249366"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145249366"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145249366"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145249366"}]},"ts":"1676145249366"} 2023-02-11 19:54:09,371 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-02-11 19:54:09,371 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 22951ff8096602d1969aa6daaf2e1413, server=jenkins-hbase4.apache.org,45897,1676145215747 in 188 msec 2023-02-11 19:54:09,373 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-02-11 19:54:09,373 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=22951ff8096602d1969aa6daaf2e1413, ASSIGN in 348 msec 2023-02-11 19:54:09,374 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:54:09,374 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145249374"}]},"ts":"1676145249374"} 2023-02-11 19:54:09,376 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-11 19:54:09,379 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:54:09,381 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 826 msec 2023-02-11 19:54:09,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-11 19:54:09,662 INFO [Listener at localhost/32929] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-02-11 19:54:09,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:09,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:09,685 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 19:54:09,685 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:09,685 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 19:54:09,685 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:09,686 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:09,686 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:09,687 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:09,687 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:09,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:09,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:09,688 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:09,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:09,688 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:09,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:09,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:09,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:09,688 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:09,692 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:09,692 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 19:54:09,692 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:09,692 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 19:54:09,692 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:09,692 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:09,692 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:09,692 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. started... 2023-02-11 19:54:09,693 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 22951ff8096602d1969aa6daaf2e1413 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-11 19:54:10,117 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511303962a72cfca44cb6bcdddd5ca207e222 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511303962a72cfca44cb6bcdddd5ca207e222 2023-02-11 19:54:10,521 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp/family1/fca25ca3a3384f68a9d934ddc7e2739c 2023-02-11 19:54:10,528 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp/family1/fca25ca3a3384f68a9d934ddc7e2739c as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/fca25ca3a3384f68a9d934ddc7e2739c 2023-02-11 19:54:10,533 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/fca25ca3a3384f68a9d934ddc7e2739c, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-11 19:54:10,534 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 22951ff8096602d1969aa6daaf2e1413 in 841ms, sequenceid=5, compaction requested=false 2023-02-11 19:54:10,535 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 19:54:10,535 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 22951ff8096602d1969aa6daaf2e1413: 2023-02-11 19:54:10,535 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:10,535 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:10,535 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:10,535 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:10,535 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 19:54:10,535 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 19:54:10,537 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,537 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:10,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:10,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:10,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:10,538 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,538 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:10,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:10,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:10,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:10,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:10,540 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 19:54:10,540 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32016754[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:10,540 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:10,540 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,542 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,542 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:10,543 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 19:54:10,543 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:10,543 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:10,543 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:10,544 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 19:54:10,544 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:10,544 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:10,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:10,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:10,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:10,544 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 19:54:10,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:10,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:10,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:10,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:10,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:10,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:10,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:10,547 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 19:54:10,547 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:10,547 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:10,547 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,547 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:10,548 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,549 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:10,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:10,549 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:10,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,549 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:10,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:10,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:10,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:10,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:10,550 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:10,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:10,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:10,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:10,552 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:10,552 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:10,553 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:10,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 19:54:10,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:10,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:10,553 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:10,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:10,553 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,553 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 19:54:10,553 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:10,553 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,553 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:10,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:10,553 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:10,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:10,553 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,554 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,554 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,654 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:10,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:10,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:10,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:10,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,660 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 19:54:10,660 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:10,660 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 19:54:10,660 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:10,661 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,661 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,662 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:10,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:10,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:10,662 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:10,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,662 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:10,663 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:10,663 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:10,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,663 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,663 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 19:54:10,664 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:10,664 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 19:54:10,664 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:10,664 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 19:54:10,664 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:10,664 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:10,664 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:10,664 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. started... 2023-02-11 19:54:10,664 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 22951ff8096602d1969aa6daaf2e1413 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-11 19:54:11,078 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128b17ac66007da4fd986c50dcbbb6c847c to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128b17ac66007da4fd986c50dcbbb6c847c 2023-02-11 19:54:11,484 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp/family1/22a021a78718421fb6506bd2a633dfeb 2023-02-11 19:54:11,489 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp/family1/22a021a78718421fb6506bd2a633dfeb as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/22a021a78718421fb6506bd2a633dfeb 2023-02-11 19:54:11,494 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/22a021a78718421fb6506bd2a633dfeb, entries=1, sequenceid=9, filesize=5.0 K 2023-02-11 19:54:11,495 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 22951ff8096602d1969aa6daaf2e1413 in 831ms, sequenceid=9, compaction requested=false 2023-02-11 19:54:11,496 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 22951ff8096602d1969aa6daaf2e1413: 2023-02-11 19:54:11,496 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:11,496 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:11,496 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:11,496 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:11,496 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 19:54:11,496 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 19:54:11,497 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:11,497 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:11,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:11,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:11,498 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:11,498 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:11,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:11,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:11,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:11,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 19:54:11,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1614944e[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:11,499 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:11,499 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,500 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,500 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:11,501 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 19:54:11,501 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:11,501 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:11,501 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:11,502 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 19:54:11,502 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:11,502 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:11,502 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 19:54:11,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:11,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:11,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:11,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:11,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:11,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:11,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:11,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:11,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:11,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:11,505 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 19:54:11,505 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:11,505 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:11,505 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,505 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:11,508 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,508 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,508 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:11,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:11,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:11,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,509 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:11,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:11,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:11,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:11,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:11,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,510 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:11,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:11,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:11,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:11,513 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:11,513 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:11,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:11,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:11,513 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:11,513 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,513 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,513 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:11,513 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:11,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 19:54:11,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:11,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:11,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:11,513 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 19:54:11,513 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,514 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,514 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,514 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:11,514 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:11,614 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:11,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:11,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:11,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:11,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,621 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 19:54:11,621 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:11,621 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 19:54:11,621 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:11,621 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,621 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,622 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:11,622 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:11,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:11,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:11,623 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:11,623 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:11,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,623 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:11,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,623 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,624 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 19:54:11,624 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:11,624 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 19:54:11,624 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:11,624 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 19:54:11,624 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:11,624 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:11,624 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:11,624 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. started... 2023-02-11 19:54:11,624 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 22951ff8096602d1969aa6daaf2e1413 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:12,039 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ab6d504f715241a1a6cd41d30cec5e4b to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201ab6d504f715241a1a6cd41d30cec5e4b 2023-02-11 19:54:12,445 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp/family1/111e7eec64df4a68b4bd91f4e745bb68 2023-02-11 19:54:12,450 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp/family1/111e7eec64df4a68b4bd91f4e745bb68 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/111e7eec64df4a68b4bd91f4e745bb68 2023-02-11 19:54:12,455 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/111e7eec64df4a68b4bd91f4e745bb68, entries=1, sequenceid=13, filesize=4.9 K 2023-02-11 19:54:12,456 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 22951ff8096602d1969aa6daaf2e1413 in 832ms, sequenceid=13, compaction requested=true 2023-02-11 19:54:12,456 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 22951ff8096602d1969aa6daaf2e1413: 2023-02-11 19:54:12,456 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:12,456 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:12,456 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:12,456 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:12,456 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 19:54:12,456 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 19:54:12,458 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:12,458 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:12,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:12,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:12,458 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,458 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:12,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:12,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:12,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:12,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:12,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 19:54:12,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70e7063b[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:12,460 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:12,460 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,462 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,462 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:12,463 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 19:54:12,463 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:12,463 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:12,463 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:12,464 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 19:54:12,464 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:12,464 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:12,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:12,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:12,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:12,464 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 19:54:12,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:12,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:12,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:12,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:12,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:12,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:12,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:12,466 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 19:54:12,466 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:12,466 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:12,466 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,466 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:12,468 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,468 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,468 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:12,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:12,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:12,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,468 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:12,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:12,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:12,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:12,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:12,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,469 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:12,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:12,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:12,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:12,476 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:12,476 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:12,476 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,476 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:12,476 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:12,476 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:12,476 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:12,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 19:54:12,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:12,476 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:12,476 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,476 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,476 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 19:54:12,476 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:12,477 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:12,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:12,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:12,577 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:12,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:12,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:12,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:12,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,584 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 19:54:12,584 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:12,584 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 19:54:12,584 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:12,584 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,584 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,586 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:12,586 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:12,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:12,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:12,586 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:12,586 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:12,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,586 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:12,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,587 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,587 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 19:54:12,587 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:12,587 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 19:54:12,587 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:12,587 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 19:54:12,587 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:12,587 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:12,587 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:12,587 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. started... 2023-02-11 19:54:12,587 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 22951ff8096602d1969aa6daaf2e1413 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:13,001 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512056da458d20c8f4356a32d4c16dc238bea to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512056da458d20c8f4356a32d4c16dc238bea 2023-02-11 19:54:13,407 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp/family1/39d68542844a466693744c4e550b282b 2023-02-11 19:54:13,413 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp/family1/39d68542844a466693744c4e550b282b as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/39d68542844a466693744c4e550b282b 2023-02-11 19:54:13,417 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/39d68542844a466693744c4e550b282b, entries=1, sequenceid=17, filesize=4.9 K 2023-02-11 19:54:13,418 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 22951ff8096602d1969aa6daaf2e1413 in 831ms, sequenceid=17, compaction requested=true 2023-02-11 19:54:13,418 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 22951ff8096602d1969aa6daaf2e1413: 2023-02-11 19:54:13,418 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:13,418 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:13,418 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:13,418 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:13,418 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 19:54:13,418 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 19:54:13,420 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:13,420 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:13,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:13,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:13,420 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,420 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:13,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:13,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:13,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:13,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:13,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 19:54:13,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f30745a[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:13,422 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:13,422 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,423 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,423 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:13,423 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 19:54:13,423 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:13,423 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:13,423 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:13,426 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 19:54:13,426 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:13,426 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:13,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:13,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:13,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:13,426 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 19:54:13,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:13,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:13,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:13,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:13,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:13,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:13,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:13,428 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 19:54:13,428 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:13,428 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:13,428 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,428 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:13,430 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,430 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:13,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:13,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,430 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:13,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:13,430 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:13,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:13,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:13,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:13,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:13,431 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:13,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:13,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:13,433 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:13,433 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,433 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:13,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 19:54:13,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:13,433 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:13,433 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:13,433 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:13,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:13,434 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:13,434 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,434 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,434 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,434 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:13,434 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:13,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:13,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:13,534 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:13,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:13,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:13,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:13,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,541 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 19:54:13,541 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:13,541 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 19:54:13,541 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:13,542 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,542 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,543 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:13,543 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:13,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:13,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:13,544 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:13,544 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:13,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:13,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,544 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,545 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 19:54:13,545 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:13,545 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 19:54:13,545 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:13,545 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 19:54:13,545 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:13,545 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:13,545 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:13,545 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. started... 2023-02-11 19:54:13,545 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 22951ff8096602d1969aa6daaf2e1413 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:13,961 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512289a843621830d4bd3a275602be56e4a63 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512289a843621830d4bd3a275602be56e4a63 2023-02-11 19:54:14,367 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp/family1/c77165c0e5eb41068343a7990321c8b0 2023-02-11 19:54:14,373 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp/family1/c77165c0e5eb41068343a7990321c8b0 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/c77165c0e5eb41068343a7990321c8b0 2023-02-11 19:54:14,381 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/c77165c0e5eb41068343a7990321c8b0, entries=1, sequenceid=21, filesize=4.9 K 2023-02-11 19:54:14,382 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 22951ff8096602d1969aa6daaf2e1413 in 837ms, sequenceid=21, compaction requested=true 2023-02-11 19:54:14,382 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 22951ff8096602d1969aa6daaf2e1413: 2023-02-11 19:54:14,382 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:14,382 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:14,382 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:14,382 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:14,382 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 19:54:14,382 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 19:54:14,388 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:14,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:14,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:14,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:14,388 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,389 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,389 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:14,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:14,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:14,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:14,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:14,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 19:54:14,393 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7632912f[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:14,393 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:14,393 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,394 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,394 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:14,394 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 19:54:14,394 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:14,394 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:14,394 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:14,395 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 19:54:14,396 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:14,396 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:14,396 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 19:54:14,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:14,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:14,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:14,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:14,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:14,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:14,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:14,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:14,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:14,398 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:14,398 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 19:54:14,398 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:14,398 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:14,398 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,398 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:14,399 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,399 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:14,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:14,400 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:14,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,400 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:14,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:14,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:14,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:14,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:14,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,401 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:14,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:14,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:14,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:14,406 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:14,406 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:14,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:14,406 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:14,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 19:54:14,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:14,406 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 19:54:14,406 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:14,406 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,406 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:14,406 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:14,407 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:14,406 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:14,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:14,407 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:14,407 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,407 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,507 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:14,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:14,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:14,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:14,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,513 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 19:54:14,514 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:14,514 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 19:54:14,514 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:14,514 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,514 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,515 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:14,515 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:14,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:14,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:14,516 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:14,516 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:14,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:14,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,517 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,517 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 19:54:14,517 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:14,517 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 19:54:14,517 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:14,517 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 19:54:14,517 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:14,517 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:14,517 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:14,517 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. started... 2023-02-11 19:54:14,517 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 22951ff8096602d1969aa6daaf2e1413 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:14,867 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 19:54:14,933 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231171a972dbb404a34b03eae82bec44df9 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231171a972dbb404a34b03eae82bec44df9 2023-02-11 19:54:15,339 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp/family1/5d36c45398064b9abcd7a233757ca748 2023-02-11 19:54:15,345 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp/family1/5d36c45398064b9abcd7a233757ca748 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/5d36c45398064b9abcd7a233757ca748 2023-02-11 19:54:15,349 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/5d36c45398064b9abcd7a233757ca748, entries=1, sequenceid=25, filesize=4.9 K 2023-02-11 19:54:15,350 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 22951ff8096602d1969aa6daaf2e1413 in 833ms, sequenceid=25, compaction requested=true 2023-02-11 19:54:15,350 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 22951ff8096602d1969aa6daaf2e1413: 2023-02-11 19:54:15,350 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:15,350 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:15,350 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:15,350 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:15,350 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 19:54:15,350 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 19:54:15,352 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:15,352 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:15,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:15,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:15,352 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:15,352 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:15,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:15,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:15,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:15,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 19:54:15,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44b6dd43[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:15,353 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:15,353 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,355 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,355 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:15,355 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 19:54:15,355 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:15,355 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:15,355 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:15,362 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:15,362 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 19:54:15,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:15,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:15,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:15,362 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:15,362 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 19:54:15,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:15,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:15,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:15,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:15,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:15,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:15,364 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:15,364 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 19:54:15,364 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:15,364 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:15,364 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,364 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:15,366 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,366 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:15,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:15,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,366 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:15,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:15,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:15,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:15,366 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:15,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:15,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:15,367 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:15,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:15,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:15,370 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:15,370 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,370 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:15,370 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:15,370 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:15,370 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:15,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 19:54:15,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 19:54:15,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:15,370 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:15,370 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:15,370 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,370 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,370 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:15,370 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:15,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:15,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:15,471 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:15,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:15,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:15,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:15,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,477 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 19:54:15,477 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:15,477 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 19:54:15,477 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:15,478 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,478 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,479 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:15,479 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:15,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:15,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:15,479 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:15,479 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:15,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,480 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:15,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,480 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,480 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 19:54:15,480 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:15,481 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 19:54:15,481 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:15,481 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 19:54:15,481 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:15,481 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:15,481 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:15,481 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. started... 2023-02-11 19:54:15,481 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 22951ff8096602d1969aa6daaf2e1413 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:15,898 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601016baad88ceb144ceca181acbc6b4bc3aa to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601016baad88ceb144ceca181acbc6b4bc3aa 2023-02-11 19:54:16,304 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp/family1/dc289613bf454efe9d521769e54db597 2023-02-11 19:54:16,309 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp/family1/dc289613bf454efe9d521769e54db597 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/dc289613bf454efe9d521769e54db597 2023-02-11 19:54:16,314 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/dc289613bf454efe9d521769e54db597, entries=1, sequenceid=29, filesize=4.9 K 2023-02-11 19:54:16,315 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 22951ff8096602d1969aa6daaf2e1413 in 834ms, sequenceid=29, compaction requested=true 2023-02-11 19:54:16,315 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 22951ff8096602d1969aa6daaf2e1413: 2023-02-11 19:54:16,315 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:16,315 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:16,315 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:16,315 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:16,316 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 19:54:16,316 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 19:54:16,317 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:16,317 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:16,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:16,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:16,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:16,318 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,318 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:16,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:16,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:16,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:16,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 19:54:16,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ca8cd30[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:16,319 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:16,319 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,320 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,320 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:16,320 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 19:54:16,320 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:16,320 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:16,320 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:16,323 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 19:54:16,323 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:16,323 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:16,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:16,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:16,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:16,323 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 19:54:16,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:16,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:16,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:16,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:16,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:16,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:16,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:16,325 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 19:54:16,325 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:16,325 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:16,325 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,325 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:16,327 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,327 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:16,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:16,327 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:16,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:16,328 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:16,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:16,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:16,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:16,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,329 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:16,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:16,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:16,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:16,331 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:16,331 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:16,331 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,331 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:16,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:16,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 19:54:16,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:16,331 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:16,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 19:54:16,331 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:16,331 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:16,332 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,332 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,332 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,332 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:16,332 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:16,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:16,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:16,432 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:16,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:16,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:16,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:16,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,444 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 19:54:16,444 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:16,444 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 19:54:16,444 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:16,444 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,444 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,446 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:16,446 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:16,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:16,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:16,447 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:16,447 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:16,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,447 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:16,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,447 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,448 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 19:54:16,448 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:16,448 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 19:54:16,448 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:16,448 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 19:54:16,448 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:16,448 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:16,448 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:16,448 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. started... 2023-02-11 19:54:16,448 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 22951ff8096602d1969aa6daaf2e1413 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:16,864 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c5c75e98bb81431da9520a75e4102446 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103c5c75e98bb81431da9520a75e4102446 2023-02-11 19:54:17,270 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp/family1/b3cd9d65e1ee4595ac333553841f963d 2023-02-11 19:54:17,279 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp/family1/b3cd9d65e1ee4595ac333553841f963d as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/b3cd9d65e1ee4595ac333553841f963d 2023-02-11 19:54:17,286 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/b3cd9d65e1ee4595ac333553841f963d, entries=1, sequenceid=33, filesize=4.9 K 2023-02-11 19:54:17,287 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 22951ff8096602d1969aa6daaf2e1413 in 839ms, sequenceid=33, compaction requested=true 2023-02-11 19:54:17,287 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 22951ff8096602d1969aa6daaf2e1413: 2023-02-11 19:54:17,287 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:17,288 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:17,288 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:17,288 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:17,288 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 19:54:17,288 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 19:54:17,289 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:17,289 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:17,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:17,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:17,290 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,290 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:17,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:17,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:17,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:17,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:17,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 19:54:17,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4076fa5b[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:17,291 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:17,291 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,293 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,293 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:17,293 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 19:54:17,293 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:17,293 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:17,293 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:17,296 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 19:54:17,296 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:17,296 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:17,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:17,296 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 19:54:17,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:17,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:17,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:17,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:17,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:17,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:17,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:17,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:17,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:17,300 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 19:54:17,300 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:17,300 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:17,300 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,300 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:17,302 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,302 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:17,302 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:17,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:17,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:17,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:17,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:17,303 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:17,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:17,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,305 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:17,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:17,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:17,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:17,310 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:17,310 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:17,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 19:54:17,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 19:54:17,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:17,310 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,310 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:17,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:17,310 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:17,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:17,310 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,311 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:17,311 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,311 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:17,311 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:17,311 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:17,311 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:17,411 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:17,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:17,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:17,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:17,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,420 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 19:54:17,420 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:17,420 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 19:54:17,420 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:17,420 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,420 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,422 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:17,423 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:17,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:17,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:17,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:17,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,425 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,425 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 19:54:17,425 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:17,425 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 19:54:17,425 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:17,425 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 19:54:17,425 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:17,425 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:17,425 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:17,425 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. started... 2023-02-11 19:54:17,426 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 22951ff8096602d1969aa6daaf2e1413 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:17,427 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:17,427 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:17,840 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509076b77386795474545b41ac7a6020fc12b to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201509076b77386795474545b41ac7a6020fc12b 2023-02-11 19:54:18,248 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp/family1/26315dca47784430ba04e36c5df69d61 2023-02-11 19:54:18,253 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp/family1/26315dca47784430ba04e36c5df69d61 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/26315dca47784430ba04e36c5df69d61 2023-02-11 19:54:18,258 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/26315dca47784430ba04e36c5df69d61, entries=1, sequenceid=37, filesize=4.9 K 2023-02-11 19:54:18,259 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 22951ff8096602d1969aa6daaf2e1413 in 833ms, sequenceid=37, compaction requested=true 2023-02-11 19:54:18,259 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 22951ff8096602d1969aa6daaf2e1413: 2023-02-11 19:54:18,259 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:18,259 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:18,259 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:18,259 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:18,259 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 19:54:18,259 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 19:54:18,261 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:18,261 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:18,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:18,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:18,261 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:18,261 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:18,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:18,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:18,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:18,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 19:54:18,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22afa093[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:18,262 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:18,262 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,267 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,267 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:18,267 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 19:54:18,267 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:18,267 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:18,267 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:18,269 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 19:54:18,269 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:18,269 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:18,269 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 19:54:18,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:18,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:18,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:18,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:18,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:18,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:18,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:18,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:18,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:18,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:18,271 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 19:54:18,271 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:18,271 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:18,271 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,271 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:18,272 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,272 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:18,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:18,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,273 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:18,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:18,273 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:18,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:18,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:18,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:18,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,274 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:18,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:18,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:18,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:18,277 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:18,277 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:18,277 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,277 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:18,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 19:54:18,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 19:54:18,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:18,277 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:18,277 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:18,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:18,278 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:18,278 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,278 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:18,278 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:18,278 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:18,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:18,278 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,378 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:18,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:18,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:18,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:18,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,384 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 19:54:18,384 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:18,384 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 19:54:18,385 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:18,385 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,385 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,386 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:18,386 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:18,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:18,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:18,386 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:18,386 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:18,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:18,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,387 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,387 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 19:54:18,387 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:18,388 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 19:54:18,388 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:18,388 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 19:54:18,388 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:18,388 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:18,388 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:18,388 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. started... 2023-02-11 19:54:18,388 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 22951ff8096602d1969aa6daaf2e1413 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:18,801 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120c6b2320c4bd545eaa6502216eaf9cd69 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120c6b2320c4bd545eaa6502216eaf9cd69 2023-02-11 19:54:19,207 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp/family1/61d598ffa3fb4599ba34ba34180a86e9 2023-02-11 19:54:19,212 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp/family1/61d598ffa3fb4599ba34ba34180a86e9 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/61d598ffa3fb4599ba34ba34180a86e9 2023-02-11 19:54:19,216 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/61d598ffa3fb4599ba34ba34180a86e9, entries=1, sequenceid=41, filesize=4.9 K 2023-02-11 19:54:19,217 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 22951ff8096602d1969aa6daaf2e1413 in 829ms, sequenceid=41, compaction requested=true 2023-02-11 19:54:19,217 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 22951ff8096602d1969aa6daaf2e1413: 2023-02-11 19:54:19,217 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:19,217 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:19,218 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:19,218 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:19,218 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 19:54:19,218 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 19:54:19,219 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:19,219 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:19,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:19,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:19,220 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,220 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:19,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:19,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:19,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:19,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:19,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 19:54:19,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50813d40[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:19,221 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:19,221 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,223 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,223 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:19,223 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 19:54:19,223 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:19,223 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:19,223 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:19,229 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 19:54:19,229 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:19,229 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:19,229 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 19:54:19,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:19,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:19,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:19,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:19,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:19,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:19,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:19,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:19,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:19,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:19,235 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 19:54:19,235 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:19,235 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:19,235 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,235 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:19,238 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,238 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:19,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:19,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,238 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:19,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:19,239 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:19,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:19,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:19,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:19,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,240 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:19,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:19,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:19,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:19,243 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:19,243 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,243 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,243 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:19,243 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:19,243 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:19,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 19:54:19,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:19,243 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:19,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:19,244 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 19:54:19,243 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:19,243 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,244 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,244 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:19,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:19,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:19,244 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:19,344 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:19,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:19,347 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40445] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-02-11 19:54:19,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 19:54:19,349 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 19:54:19,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:54:19,350 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676145859350 2023-02-11 19:54:19,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-11 19:54:19,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-11 19:54:19,354 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 19:54:19,354 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] zookeeper.ReadOnlyZKClient(139): Connect 0x7560e6ec to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:54:19,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@742bb5ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:54:19,359 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 19:54:20,200 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f8c91d111f79406ba1daacfe41e12a91 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103f8c91d111f79406ba1daacfe41e12a91 2023-02-11 19:54:20,201 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 19:54:20,213 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:54:20,214 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59218, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:54:20,221 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:54:20,222 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51960, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:54:20,231 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e74d4b8acc954791a3ae2aff8b2bcb48 first=Optional[r3] last=Optional[r6] 2023-02-11 19:54:20,231 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e74d4b8acc954791a3ae2aff8b2bcb48}] 2023-02-11 19:54:20,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e74d4b8acc954791a3ae2aff8b2bcb48 for inclusion in 22951ff8096602d1969aa6daaf2e1413/family1 2023-02-11 19:54:20,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-11 19:54:20,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 19:54:20,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 22951ff8096602d1969aa6daaf2e1413: 2023-02-11 19:54:20,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e74d4b8acc954791a3ae2aff8b2bcb48 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithWeeklyPolicy__2olcrth40ehe04n0nou2lb9rhemuos7q1thkkovpjht03of0hkv4rvt1aardvfuj/family1/e74d4b8acc954791a3ae2aff8b2bcb48 2023-02-11 19:54:20,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithWeeklyPolicy__2olcrth40ehe04n0nou2lb9rhemuos7q1thkkovpjht03of0hkv4rvt1aardvfuj/family1/e74d4b8acc954791a3ae2aff8b2bcb48 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/e7b6e38a88014fc8a7a12da59cfb60ca_SeqId_44_ 2023-02-11 19:54:20,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithWeeklyPolicy__2olcrth40ehe04n0nou2lb9rhemuos7q1thkkovpjht03of0hkv4rvt1aardvfuj/family1/e74d4b8acc954791a3ae2aff8b2bcb48 into 22951ff8096602d1969aa6daaf2e1413/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/e7b6e38a88014fc8a7a12da59cfb60ca_SeqId_44_ - updating store file list. 2023-02-11 19:54:20,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/e7b6e38a88014fc8a7a12da59cfb60ca_SeqId_44_ into 22951ff8096602d1969aa6daaf2e1413/family1 2023-02-11 19:54:20,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithWeeklyPolicy__2olcrth40ehe04n0nou2lb9rhemuos7q1thkkovpjht03of0hkv4rvt1aardvfuj/family1/e74d4b8acc954791a3ae2aff8b2bcb48 into 22951ff8096602d1969aa6daaf2e1413/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/e7b6e38a88014fc8a7a12da59cfb60ca_SeqId_44_) 2023-02-11 19:54:20,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithWeeklyPolicy__2olcrth40ehe04n0nou2lb9rhemuos7q1thkkovpjht03of0hkv4rvt1aardvfuj/family1/e74d4b8acc954791a3ae2aff8b2bcb48 2023-02-11 19:54:20,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-11 19:54:20,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-11 19:54:20,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(1912): 22951ff8096602d1969aa6daaf2e1413/family1 is initiating minor compaction 2023-02-11 19:54:20,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4774a810; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:54:20,251 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 22951ff8096602d1969aa6daaf2e1413/family1 in testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:20,251 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/22a021a78718421fb6506bd2a633dfeb, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/111e7eec64df4a68b4bd91f4e745bb68, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/39d68542844a466693744c4e550b282b, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/c77165c0e5eb41068343a7990321c8b0, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/5d36c45398064b9abcd7a233757ca748, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/dc289613bf454efe9d521769e54db597, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/b3cd9d65e1ee4595ac333553841f963d, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/26315dca47784430ba04e36c5df69d61, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/61d598ffa3fb4599ba34ba34180a86e9, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/e7b6e38a88014fc8a7a12da59cfb60ca_SeqId_44_] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp, totalSize=50.0 K 2023-02-11 19:54:20,251 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 22a021a78718421fb6506bd2a633dfeb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 19:54:20,251 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 111e7eec64df4a68b4bd91f4e745bb68, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 19:54:20,251 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 39d68542844a466693744c4e550b282b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-11 19:54:20,251 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting c77165c0e5eb41068343a7990321c8b0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-11 19:54:20,251 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 5d36c45398064b9abcd7a233757ca748, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-11 19:54:20,251 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting dc289613bf454efe9d521769e54db597, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-11 19:54:20,251 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting b3cd9d65e1ee4595ac333553841f963d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-11 19:54:20,251 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 26315dca47784430ba04e36c5df69d61, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-11 19:54:20,252 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 61d598ffa3fb4599ba34ba34180a86e9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-11 19:54:20,252 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting e7b6e38a88014fc8a7a12da59cfb60ca_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-11 19:54:20,253 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 19:54:20,254 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:54:20,256 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512289a843621830d4bd3a275602be56e4a63 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512289a843621830d4bd3a275602be56e4a63 2023-02-11 19:54:20,257 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231171a972dbb404a34b03eae82bec44df9 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231171a972dbb404a34b03eae82bec44df9 2023-02-11 19:54:20,258 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601016baad88ceb144ceca181acbc6b4bc3aa to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601016baad88ceb144ceca181acbc6b4bc3aa 2023-02-11 19:54:20,260 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103c5c75e98bb81431da9520a75e4102446 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103c5c75e98bb81431da9520a75e4102446 2023-02-11 19:54:20,260 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-11 19:54:20,260 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-11 19:54:20,260 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 19:54:20,260 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 19:54:20,260 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 19:54:20,260 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 19:54:20,260 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 19:54:20,261 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 19:54:20,261 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 19:54:20,261 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 19:54:20,279 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] throttle.PressureAwareThroughputController(145): 22951ff8096602d1969aa6daaf2e1413#family1#compaction#34 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:54:20,696 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512058563dfd813ec429d878bb998c92ee643 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512058563dfd813ec429d878bb998c92ee643 2023-02-11 19:54:20,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 19:54:20,698 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp/family1/f1bd5a91b8674f579c5247344f39d6b2 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/f1bd5a91b8674f579c5247344f39d6b2 2023-02-11 19:54:20,704 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 22951ff8096602d1969aa6daaf2e1413/family1 of 22951ff8096602d1969aa6daaf2e1413 into f1bd5a91b8674f579c5247344f39d6b2(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 19:54:20,704 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 22951ff8096602d1969aa6daaf2e1413: 2023-02-11 19:54:20,704 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1676145260251; duration=0sec 2023-02-11 19:54:20,704 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:54:20,728 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b37287fd557d4bd8a63241be5c274419 first=Optional[r1] last=Optional[r2] 2023-02-11 19:54:20,729 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b37287fd557d4bd8a63241be5c274419}] 2023-02-11 19:54:20,731 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/22a021a78718421fb6506bd2a633dfeb, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/111e7eec64df4a68b4bd91f4e745bb68, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/39d68542844a466693744c4e550b282b, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/c77165c0e5eb41068343a7990321c8b0, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/5d36c45398064b9abcd7a233757ca748, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/dc289613bf454efe9d521769e54db597, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/b3cd9d65e1ee4595ac333553841f963d, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/26315dca47784430ba04e36c5df69d61, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/61d598ffa3fb4599ba34ba34180a86e9, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/e7b6e38a88014fc8a7a12da59cfb60ca_SeqId_44_] to archive 2023-02-11 19:54:20,732 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:54:20,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b37287fd557d4bd8a63241be5c274419 for inclusion in 22951ff8096602d1969aa6daaf2e1413/family1 2023-02-11 19:54:20,734 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/22a021a78718421fb6506bd2a633dfeb to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/22a021a78718421fb6506bd2a633dfeb 2023-02-11 19:54:20,736 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/111e7eec64df4a68b4bd91f4e745bb68 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/111e7eec64df4a68b4bd91f4e745bb68 2023-02-11 19:54:20,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-11 19:54:20,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 19:54:20,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 22951ff8096602d1969aa6daaf2e1413: 2023-02-11 19:54:20,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/39d68542844a466693744c4e550b282b to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/39d68542844a466693744c4e550b282b 2023-02-11 19:54:20,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b37287fd557d4bd8a63241be5c274419 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1hk9e25sg86d5ptboh5u58tlg3qgpoil5r3753gln6t2ugf9bb4gkn9d00t2sisl/family1/b37287fd557d4bd8a63241be5c274419 2023-02-11 19:54:20,739 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/c77165c0e5eb41068343a7990321c8b0 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/c77165c0e5eb41068343a7990321c8b0 2023-02-11 19:54:20,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1hk9e25sg86d5ptboh5u58tlg3qgpoil5r3753gln6t2ugf9bb4gkn9d00t2sisl/family1/b37287fd557d4bd8a63241be5c274419 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/3934a49631bc4e10be5b46aa3dc70079_SeqId_47_ 2023-02-11 19:54:20,741 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/5d36c45398064b9abcd7a233757ca748 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/5d36c45398064b9abcd7a233757ca748 2023-02-11 19:54:20,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1hk9e25sg86d5ptboh5u58tlg3qgpoil5r3753gln6t2ugf9bb4gkn9d00t2sisl/family1/b37287fd557d4bd8a63241be5c274419 into 22951ff8096602d1969aa6daaf2e1413/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/3934a49631bc4e10be5b46aa3dc70079_SeqId_47_ - updating store file list. 2023-02-11 19:54:20,742 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/dc289613bf454efe9d521769e54db597 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/dc289613bf454efe9d521769e54db597 2023-02-11 19:54:20,744 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/b3cd9d65e1ee4595ac333553841f963d to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/b3cd9d65e1ee4595ac333553841f963d 2023-02-11 19:54:20,745 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/26315dca47784430ba04e36c5df69d61 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/26315dca47784430ba04e36c5df69d61 2023-02-11 19:54:20,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/3934a49631bc4e10be5b46aa3dc70079_SeqId_47_ into 22951ff8096602d1969aa6daaf2e1413/family1 2023-02-11 19:54:20,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1hk9e25sg86d5ptboh5u58tlg3qgpoil5r3753gln6t2ugf9bb4gkn9d00t2sisl/family1/b37287fd557d4bd8a63241be5c274419 into 22951ff8096602d1969aa6daaf2e1413/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/3934a49631bc4e10be5b46aa3dc70079_SeqId_47_) 2023-02-11 19:54:20,747 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/61d598ffa3fb4599ba34ba34180a86e9 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/61d598ffa3fb4599ba34ba34180a86e9 2023-02-11 19:54:20,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1hk9e25sg86d5ptboh5u58tlg3qgpoil5r3753gln6t2ugf9bb4gkn9d00t2sisl/family1/b37287fd557d4bd8a63241be5c274419 2023-02-11 19:54:20,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-11 19:54:20,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-11 19:54:20,748 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/e7b6e38a88014fc8a7a12da59cfb60ca_SeqId_44_ to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/e7b6e38a88014fc8a7a12da59cfb60ca_SeqId_44_ 2023-02-11 19:54:20,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(1912): 22951ff8096602d1969aa6daaf2e1413/family1 is initiating minor compaction (all files) 2023-02-11 19:54:20,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@c185f48; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:54:20,748 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 22951ff8096602d1969aa6daaf2e1413/family1 in testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:54:20,749 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/fca25ca3a3384f68a9d934ddc7e2739c, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/f1bd5a91b8674f579c5247344f39d6b2, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/3934a49631bc4e10be5b46aa3dc70079_SeqId_47_] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp, totalSize=176.8 K 2023-02-11 19:54:20,749 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting fca25ca3a3384f68a9d934ddc7e2739c, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878840136 2023-02-11 19:54:20,750 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting f1bd5a91b8674f579c5247344f39d6b2, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621240136 2023-02-11 19:54:20,750 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 3934a49631bc4e10be5b46aa3dc70079_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965240136 2023-02-11 19:54:20,750 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 19:54:20,751 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:54:20,752 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201ab6d504f715241a1a6cd41d30cec5e4b to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201ab6d504f715241a1a6cd41d30cec5e4b 2023-02-11 19:54:20,754 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512056da458d20c8f4356a32d4c16dc238bea to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512056da458d20c8f4356a32d4c16dc238bea 2023-02-11 19:54:20,754 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-02-11 19:54:20,754 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-11 19:54:20,755 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 19:54:20,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 19:54:20,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:54:20,756 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 19:54:20,758 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4090 sec 2023-02-11 19:54:20,769 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] throttle.PressureAwareThroughputController(145): 22951ff8096602d1969aa6daaf2e1413#family1#compaction#35 average throughput is 17.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:54:20,865 INFO [Listener at localhost/32929] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=253 (was 249) - Thread LEAK? -, OpenFileDescriptor=596 (was 592) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=409 (was 437), ProcessCount=168 (was 168), AvailableMemoryMB=3770 (was 3896) 2023-02-11 19:54:20,877 INFO [Listener at localhost/32929] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=253, OpenFileDescriptor=596, MaxFileDescriptor=60000, SystemLoadAverage=409, ProcessCount=168, AvailableMemoryMB=3766 2023-02-11 19:54:20,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-11 19:54:20,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:20,883 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:54:20,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-02-11 19:54:20,884 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:54:20,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-11 19:54:20,888 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testScannerOnBulkLoadRefHFiles/9e0c530d5d033c122144679ce520b6e5 2023-02-11 19:54:20,888 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testScannerOnBulkLoadRefHFiles/17a611547a606c5d3b8c51f9809db923 2023-02-11 19:54:20,889 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d 2023-02-11 19:54:20,889 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testScannerOnBulkLoadRefHFiles/9e0c530d5d033c122144679ce520b6e5 empty. 2023-02-11 19:54:20,889 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testScannerOnBulkLoadRefHFiles/17a611547a606c5d3b8c51f9809db923 empty. 2023-02-11 19:54:20,890 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testScannerOnBulkLoadRefHFiles/9e0c530d5d033c122144679ce520b6e5 2023-02-11 19:54:20,890 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d empty. 2023-02-11 19:54:20,890 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testScannerOnBulkLoadRefHFiles/17a611547a606c5d3b8c51f9809db923 2023-02-11 19:54:20,892 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d 2023-02-11 19:54:20,892 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-02-11 19:54:20,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-11 19:54:21,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-11 19:54:21,307 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-02-11 19:54:21,308 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9e0c530d5d033c122144679ce520b6e5, NAME => 'testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp 2023-02-11 19:54:21,308 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7671): creating {ENCODED => 91920e03fd524f4120fe99584949959d, NAME => 'testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp 2023-02-11 19:54:21,309 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7671): creating {ENCODED => 17a611547a606c5d3b8c51f9809db923, NAME => 'testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp 2023-02-11 19:54:21,316 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:54:21,316 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:54:21,316 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1603): Closing 9e0c530d5d033c122144679ce520b6e5, disabling compactions & flushes 2023-02-11 19:54:21,316 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1603): Closing 17a611547a606c5d3b8c51f9809db923, disabling compactions & flushes 2023-02-11 19:54:21,316 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5. 2023-02-11 19:54:21,316 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923. 2023-02-11 19:54:21,317 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5. 2023-02-11 19:54:21,317 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923. 2023-02-11 19:54:21,317 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5. after waiting 0 ms 2023-02-11 19:54:21,317 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923. after waiting 0 ms 2023-02-11 19:54:21,317 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5. 2023-02-11 19:54:21,317 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923. 2023-02-11 19:54:21,317 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5. 2023-02-11 19:54:21,317 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923. 2023-02-11 19:54:21,317 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1557): Region close journal for 9e0c530d5d033c122144679ce520b6e5: Waiting for close lock at 1676145261316Disabling compacts and flushes for region at 1676145261316Disabling writes for close at 1676145261317 (+1 ms)Writing region close event to WAL at 1676145261317Closed at 1676145261317 2023-02-11 19:54:21,317 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1557): Region close journal for 17a611547a606c5d3b8c51f9809db923: Waiting for close lock at 1676145261316Disabling compacts and flushes for region at 1676145261316Disabling writes for close at 1676145261317 (+1 ms)Writing region close event to WAL at 1676145261317Closed at 1676145261317 2023-02-11 19:54:21,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-11 19:54:21,717 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:54:21,717 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1603): Closing 91920e03fd524f4120fe99584949959d, disabling compactions & flushes 2023-02-11 19:54:21,717 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d. 2023-02-11 19:54:21,717 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d. 2023-02-11 19:54:21,717 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d. after waiting 0 ms 2023-02-11 19:54:21,717 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d. 2023-02-11 19:54:21,717 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d. 2023-02-11 19:54:21,717 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1557): Region close journal for 91920e03fd524f4120fe99584949959d: Waiting for close lock at 1676145261717Disabling compacts and flushes for region at 1676145261717Disabling writes for close at 1676145261717Writing region close event to WAL at 1676145261717Closed at 1676145261717 2023-02-11 19:54:21,720 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:54:21,721 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676145261721"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145261721"}]},"ts":"1676145261721"} 2023-02-11 19:54:21,721 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676145261721"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145261721"}]},"ts":"1676145261721"} 2023-02-11 19:54:21,721 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676145261721"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145261721"}]},"ts":"1676145261721"} 2023-02-11 19:54:21,724 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-11 19:54:21,725 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:54:21,725 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145261725"}]},"ts":"1676145261725"} 2023-02-11 19:54:21,726 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-02-11 19:54:21,735 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=9e0c530d5d033c122144679ce520b6e5, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=17a611547a606c5d3b8c51f9809db923, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=91920e03fd524f4120fe99584949959d, ASSIGN}] 2023-02-11 19:54:21,737 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=9e0c530d5d033c122144679ce520b6e5, ASSIGN 2023-02-11 19:54:21,737 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=91920e03fd524f4120fe99584949959d, ASSIGN 2023-02-11 19:54:21,737 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=17a611547a606c5d3b8c51f9809db923, ASSIGN 2023-02-11 19:54:21,738 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=17a611547a606c5d3b8c51f9809db923, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=false 2023-02-11 19:54:21,738 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=91920e03fd524f4120fe99584949959d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=false 2023-02-11 19:54:21,738 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=9e0c530d5d033c122144679ce520b6e5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=false 2023-02-11 19:54:21,889 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9e0c530d5d033c122144679ce520b6e5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:21,889 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=17a611547a606c5d3b8c51f9809db923, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:21,889 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=91920e03fd524f4120fe99584949959d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:21,889 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676145261889"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145261889"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145261889"}]},"ts":"1676145261889"} 2023-02-11 19:54:21,890 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676145261889"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145261889"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145261889"}]},"ts":"1676145261889"} 2023-02-11 19:54:21,890 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676145261889"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145261889"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145261889"}]},"ts":"1676145261889"} 2023-02-11 19:54:21,891 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 9e0c530d5d033c122144679ce520b6e5, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:54:21,892 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=29, state=RUNNABLE; OpenRegionProcedure 17a611547a606c5d3b8c51f9809db923, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:54:21,893 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; OpenRegionProcedure 91920e03fd524f4120fe99584949959d, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:54:21,987 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/.tmp/family1/b0ddc87465044f9abcf7c52569e5cfe5 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/b0ddc87465044f9abcf7c52569e5cfe5 2023-02-11 19:54:21,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-11 19:54:21,992 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 22951ff8096602d1969aa6daaf2e1413/family1 of 22951ff8096602d1969aa6daaf2e1413 into b0ddc87465044f9abcf7c52569e5cfe5(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 19:54:21,992 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 22951ff8096602d1969aa6daaf2e1413: 2023-02-11 19:54:21,992 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1676145260748; duration=1sec 2023-02-11 19:54:21,992 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:54:22,020 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/fca25ca3a3384f68a9d934ddc7e2739c, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/f1bd5a91b8674f579c5247344f39d6b2, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/3934a49631bc4e10be5b46aa3dc70079_SeqId_47_] to archive 2023-02-11 19:54:22,021 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:54:22,023 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/fca25ca3a3384f68a9d934ddc7e2739c to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/fca25ca3a3384f68a9d934ddc7e2739c 2023-02-11 19:54:22,024 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/f1bd5a91b8674f579c5247344f39d6b2 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/f1bd5a91b8674f579c5247344f39d6b2 2023-02-11 19:54:22,025 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/3934a49631bc4e10be5b46aa3dc70079_SeqId_47_ to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/family1/3934a49631bc4e10be5b46aa3dc70079_SeqId_47_ 2023-02-11 19:54:22,046 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d. 2023-02-11 19:54:22,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 91920e03fd524f4120fe99584949959d, NAME => 'testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d.', STARTKEY => '2', ENDKEY => ''} 2023-02-11 19:54:22,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 91920e03fd524f4120fe99584949959d 2023-02-11 19:54:22,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:54:22,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 91920e03fd524f4120fe99584949959d 2023-02-11 19:54:22,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 91920e03fd524f4120fe99584949959d 2023-02-11 19:54:22,048 INFO [StoreOpener-91920e03fd524f4120fe99584949959d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 91920e03fd524f4120fe99584949959d 2023-02-11 19:54:22,049 DEBUG [StoreOpener-91920e03fd524f4120fe99584949959d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family1 2023-02-11 19:54:22,049 DEBUG [StoreOpener-91920e03fd524f4120fe99584949959d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family1 2023-02-11 19:54:22,050 INFO [StoreOpener-91920e03fd524f4120fe99584949959d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91920e03fd524f4120fe99584949959d columnFamilyName family1 2023-02-11 19:54:22,051 INFO [StoreOpener-91920e03fd524f4120fe99584949959d-1] regionserver.HStore(310): Store=91920e03fd524f4120fe99584949959d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:54:22,051 INFO [StoreOpener-91920e03fd524f4120fe99584949959d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 91920e03fd524f4120fe99584949959d 2023-02-11 19:54:22,053 DEBUG [StoreOpener-91920e03fd524f4120fe99584949959d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family2 2023-02-11 19:54:22,053 DEBUG [StoreOpener-91920e03fd524f4120fe99584949959d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family2 2023-02-11 19:54:22,053 INFO [StoreOpener-91920e03fd524f4120fe99584949959d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91920e03fd524f4120fe99584949959d columnFamilyName family2 2023-02-11 19:54:22,055 INFO [StoreOpener-91920e03fd524f4120fe99584949959d-1] regionserver.HStore(310): Store=91920e03fd524f4120fe99584949959d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:54:22,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d 2023-02-11 19:54:22,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d 2023-02-11 19:54:22,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:54:22,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 91920e03fd524f4120fe99584949959d 2023-02-11 19:54:22,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:54:22,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 91920e03fd524f4120fe99584949959d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65467326, jitterRate=-0.024460822343826294}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:54:22,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 91920e03fd524f4120fe99584949959d: Running coprocessor pre-open hook at 1676145262047Writing region info on filesystem at 1676145262047Initializing all the Stores at 1676145262048 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145262048Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145262048Cleaning up temporary data from old regions at 1676145262057 (+9 ms)Cleaning up detritus from prior splits at 1676145262058 (+1 ms)Running coprocessor post-open hooks at 1676145262062 (+4 ms)Region opened successfully at 1676145262062 2023-02-11 19:54:22,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d., pid=33, masterSystemTime=1676145262043 2023-02-11 19:54:22,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d. 2023-02-11 19:54:22,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d. 2023-02-11 19:54:22,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5. 2023-02-11 19:54:22,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9e0c530d5d033c122144679ce520b6e5, NAME => 'testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5.', STARTKEY => '', ENDKEY => '1'} 2023-02-11 19:54:22,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 9e0c530d5d033c122144679ce520b6e5 2023-02-11 19:54:22,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:54:22,065 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=91920e03fd524f4120fe99584949959d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:22,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9e0c530d5d033c122144679ce520b6e5 2023-02-11 19:54:22,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9e0c530d5d033c122144679ce520b6e5 2023-02-11 19:54:22,065 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676145262065"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145262065"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145262065"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145262065"}]},"ts":"1676145262065"} 2023-02-11 19:54:22,066 INFO [StoreOpener-9e0c530d5d033c122144679ce520b6e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9e0c530d5d033c122144679ce520b6e5 2023-02-11 19:54:22,068 DEBUG [StoreOpener-9e0c530d5d033c122144679ce520b6e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/9e0c530d5d033c122144679ce520b6e5/family1 2023-02-11 19:54:22,068 DEBUG [StoreOpener-9e0c530d5d033c122144679ce520b6e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/9e0c530d5d033c122144679ce520b6e5/family1 2023-02-11 19:54:22,068 INFO [StoreOpener-9e0c530d5d033c122144679ce520b6e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e0c530d5d033c122144679ce520b6e5 columnFamilyName family1 2023-02-11 19:54:22,068 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=30 2023-02-11 19:54:22,069 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=30, state=SUCCESS; OpenRegionProcedure 91920e03fd524f4120fe99584949959d, server=jenkins-hbase4.apache.org,45897,1676145215747 in 173 msec 2023-02-11 19:54:22,069 INFO [StoreOpener-9e0c530d5d033c122144679ce520b6e5-1] regionserver.HStore(310): Store=9e0c530d5d033c122144679ce520b6e5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:54:22,070 INFO [StoreOpener-9e0c530d5d033c122144679ce520b6e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9e0c530d5d033c122144679ce520b6e5 2023-02-11 19:54:22,070 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=91920e03fd524f4120fe99584949959d, ASSIGN in 334 msec 2023-02-11 19:54:22,071 DEBUG [StoreOpener-9e0c530d5d033c122144679ce520b6e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/9e0c530d5d033c122144679ce520b6e5/family2 2023-02-11 19:54:22,071 DEBUG [StoreOpener-9e0c530d5d033c122144679ce520b6e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/9e0c530d5d033c122144679ce520b6e5/family2 2023-02-11 19:54:22,072 INFO [StoreOpener-9e0c530d5d033c122144679ce520b6e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e0c530d5d033c122144679ce520b6e5 columnFamilyName family2 2023-02-11 19:54:22,073 INFO [StoreOpener-9e0c530d5d033c122144679ce520b6e5-1] regionserver.HStore(310): Store=9e0c530d5d033c122144679ce520b6e5/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:54:22,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/9e0c530d5d033c122144679ce520b6e5 2023-02-11 19:54:22,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/9e0c530d5d033c122144679ce520b6e5 2023-02-11 19:54:22,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:54:22,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9e0c530d5d033c122144679ce520b6e5 2023-02-11 19:54:22,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/9e0c530d5d033c122144679ce520b6e5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:54:22,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9e0c530d5d033c122144679ce520b6e5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72793108, jitterRate=0.08470183610916138}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:54:22,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9e0c530d5d033c122144679ce520b6e5: Running coprocessor pre-open hook at 1676145262065Writing region info on filesystem at 1676145262065Initializing all the Stores at 1676145262066 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145262066Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145262066Cleaning up temporary data from old regions at 1676145262074 (+8 ms)Cleaning up detritus from prior splits at 1676145262075 (+1 ms)Running coprocessor post-open hooks at 1676145262078 (+3 ms)Region opened successfully at 1676145262078 2023-02-11 19:54:22,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5., pid=31, masterSystemTime=1676145262043 2023-02-11 19:54:22,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5. 2023-02-11 19:54:22,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5. 2023-02-11 19:54:22,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923. 2023-02-11 19:54:22,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 17a611547a606c5d3b8c51f9809db923, NAME => 'testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923.', STARTKEY => '1', ENDKEY => '2'} 2023-02-11 19:54:22,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 17a611547a606c5d3b8c51f9809db923 2023-02-11 19:54:22,081 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9e0c530d5d033c122144679ce520b6e5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:22,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:54:22,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 17a611547a606c5d3b8c51f9809db923 2023-02-11 19:54:22,081 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676145262081"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145262081"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145262081"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145262081"}]},"ts":"1676145262081"} 2023-02-11 19:54:22,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 17a611547a606c5d3b8c51f9809db923 2023-02-11 19:54:22,082 INFO [StoreOpener-17a611547a606c5d3b8c51f9809db923-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 17a611547a606c5d3b8c51f9809db923 2023-02-11 19:54:22,083 DEBUG [StoreOpener-17a611547a606c5d3b8c51f9809db923-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/17a611547a606c5d3b8c51f9809db923/family1 2023-02-11 19:54:22,083 DEBUG [StoreOpener-17a611547a606c5d3b8c51f9809db923-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/17a611547a606c5d3b8c51f9809db923/family1 2023-02-11 19:54:22,084 INFO [StoreOpener-17a611547a606c5d3b8c51f9809db923-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17a611547a606c5d3b8c51f9809db923 columnFamilyName family1 2023-02-11 19:54:22,084 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-02-11 19:54:22,084 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 9e0c530d5d033c122144679ce520b6e5, server=jenkins-hbase4.apache.org,45897,1676145215747 in 191 msec 2023-02-11 19:54:22,085 INFO [StoreOpener-17a611547a606c5d3b8c51f9809db923-1] regionserver.HStore(310): Store=17a611547a606c5d3b8c51f9809db923/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:54:22,085 INFO [StoreOpener-17a611547a606c5d3b8c51f9809db923-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 17a611547a606c5d3b8c51f9809db923 2023-02-11 19:54:22,085 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=9e0c530d5d033c122144679ce520b6e5, ASSIGN in 349 msec 2023-02-11 19:54:22,086 DEBUG [StoreOpener-17a611547a606c5d3b8c51f9809db923-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/17a611547a606c5d3b8c51f9809db923/family2 2023-02-11 19:54:22,086 DEBUG [StoreOpener-17a611547a606c5d3b8c51f9809db923-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/17a611547a606c5d3b8c51f9809db923/family2 2023-02-11 19:54:22,087 INFO [StoreOpener-17a611547a606c5d3b8c51f9809db923-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17a611547a606c5d3b8c51f9809db923 columnFamilyName family2 2023-02-11 19:54:22,087 INFO [StoreOpener-17a611547a606c5d3b8c51f9809db923-1] regionserver.HStore(310): Store=17a611547a606c5d3b8c51f9809db923/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:54:22,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/17a611547a606c5d3b8c51f9809db923 2023-02-11 19:54:22,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/17a611547a606c5d3b8c51f9809db923 2023-02-11 19:54:22,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:54:22,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 17a611547a606c5d3b8c51f9809db923 2023-02-11 19:54:22,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/17a611547a606c5d3b8c51f9809db923/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:54:22,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 17a611547a606c5d3b8c51f9809db923; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73213576, jitterRate=0.09096729755401611}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:54:22,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 17a611547a606c5d3b8c51f9809db923: Running coprocessor pre-open hook at 1676145262081Writing region info on filesystem at 1676145262081Initializing all the Stores at 1676145262082 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145262082Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145262082Cleaning up temporary data from old regions at 1676145262089 (+7 ms)Cleaning up detritus from prior splits at 1676145262089Running coprocessor post-open hooks at 1676145262093 (+4 ms)Region opened successfully at 1676145262093 2023-02-11 19:54:22,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923., pid=32, masterSystemTime=1676145262043 2023-02-11 19:54:22,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923. 2023-02-11 19:54:22,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923. 2023-02-11 19:54:22,095 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=17a611547a606c5d3b8c51f9809db923, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:22,096 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676145262095"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145262095"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145262095"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145262095"}]},"ts":"1676145262095"} 2023-02-11 19:54:22,098 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=29 2023-02-11 19:54:22,098 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=29, state=SUCCESS; OpenRegionProcedure 17a611547a606c5d3b8c51f9809db923, server=jenkins-hbase4.apache.org,45897,1676145215747 in 205 msec 2023-02-11 19:54:22,100 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-02-11 19:54:22,100 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=17a611547a606c5d3b8c51f9809db923, ASSIGN in 363 msec 2023-02-11 19:54:22,101 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:54:22,101 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145262101"}]},"ts":"1676145262101"} 2023-02-11 19:54:22,102 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-02-11 19:54:22,104 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:54:22,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2230 sec 2023-02-11 19:54:22,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-11 19:54:22,990 INFO [Listener at localhost/32929] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-02-11 19:54:22,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:22,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:22,999 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-11 19:54:22,999 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:22,999 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-11 19:54:22,999 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-11 19:54:22,999 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:22,999 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,001 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:23,001 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:23,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:23,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:23,001 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:23,001 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:23,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,001 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:23,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,002 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,002 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,002 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-11 19:54:23,002 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:23,002 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-11 19:54:23,002 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923. 2023-02-11 19:54:23,002 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923. started... 2023-02-11 19:54:23,002 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 19:54:23,002 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:23,002 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5. 2023-02-11 19:54:23,003 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 17a611547a606c5d3b8c51f9809db923: 2023-02-11 19:54:23,003 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5. started... 2023-02-11 19:54:23,003 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923. 2023-02-11 19:54:23,003 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d. 2023-02-11 19:54:23,004 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 9e0c530d5d033c122144679ce520b6e5: 2023-02-11 19:54:23,004 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 19:54:23,004 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5. 2023-02-11 19:54:23,004 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d. started... 2023-02-11 19:54:23,004 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 19:54:23,004 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 91920e03fd524f4120fe99584949959d 2/2 column families, dataSize=48 B heapSize=632 B 2023-02-11 19:54:23,418 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211a83436683f8f47e5b474ca1fdb246d98 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230211a83436683f8f47e5b474ca1fdb246d98 2023-02-11 19:54:23,824 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/.tmp/family1/1eebb874b63749bb89cc5e69b574a62a 2023-02-11 19:54:23,829 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/.tmp/family1/1eebb874b63749bb89cc5e69b574a62a as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family1/1eebb874b63749bb89cc5e69b574a62a 2023-02-11 19:54:23,834 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family1/1eebb874b63749bb89cc5e69b574a62a, entries=1, sequenceid=5, filesize=4.9 K 2023-02-11 19:54:23,835 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 91920e03fd524f4120fe99584949959d in 831ms, sequenceid=5, compaction requested=false 2023-02-11 19:54:23,835 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-02-11 19:54:23,835 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 91920e03fd524f4120fe99584949959d: 2023-02-11 19:54:23,835 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d. 2023-02-11 19:54:23,835 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 19:54:23,835 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 19:54:23,835 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:23,835 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-11 19:54:23,836 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-11 19:54:23,838 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:23,838 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:23,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:23,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:23,838 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,838 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:23,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:23,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:23,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:23,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:23,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-11 19:54:23,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a0abb2d[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:23,839 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-11 19:54:23,839 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,840 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,841 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-11 19:54:23,841 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-11 19:54:23,841 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:23,841 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:23,841 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:23,842 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:23,842 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-11 19:54:23,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:23,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:23,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:23,842 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:23,842 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-11 19:54:23,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:23,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:23,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-11 19:54:23,844 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-11 19:54:23,844 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:23,844 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:23,844 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,844 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:23,846 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,846 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:23,846 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,846 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:23,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:23,847 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:23,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:23,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:23,853 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:23,853 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:23,853 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:23,853 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:23,853 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,854 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,854 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:23,854 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-11 19:54:23,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:23,854 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-11 19:54:23,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:23,854 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:23,854 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,854 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:23,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:23,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:23,854 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:23,955 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:23,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:23,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:23,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:23,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,964 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-11 19:54:23,964 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:23,964 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-11 19:54:23,964 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-11 19:54:23,965 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,965 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,966 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:23,966 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:23,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:23,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:23,967 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:23,967 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:23,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,968 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:23,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,968 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,969 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-02-11 19:54:23,969 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:23,969 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-11 19:54:23,969 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:23,969 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-11 19:54:23,969 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923. 2023-02-11 19:54:23,970 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923. started... 2023-02-11 19:54:23,970 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5. 2023-02-11 19:54:23,970 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 19:54:23,970 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:23,970 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 17a611547a606c5d3b8c51f9809db923: 2023-02-11 19:54:23,970 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923. 2023-02-11 19:54:23,970 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5. started... 2023-02-11 19:54:23,970 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 19:54:23,970 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d. 2023-02-11 19:54:23,970 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d. started... 2023-02-11 19:54:23,970 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 9e0c530d5d033c122144679ce520b6e5: 2023-02-11 19:54:23,970 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 91920e03fd524f4120fe99584949959d 2/2 column families, dataSize=90 B heapSize=752 B 2023-02-11 19:54:23,971 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5. 2023-02-11 19:54:23,971 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 19:54:23,996 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302118dbe63f8e3f3454383f093177623b0c4 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302118dbe63f8e3f3454383f093177623b0c4 2023-02-11 19:54:24,402 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/.tmp/family1/79ac421465ee4699a0584be8de54088a 2023-02-11 19:54:24,407 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/.tmp/family1/79ac421465ee4699a0584be8de54088a as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family1/79ac421465ee4699a0584be8de54088a 2023-02-11 19:54:24,412 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family1/79ac421465ee4699a0584be8de54088a, entries=2, sequenceid=9, filesize=5.0 K 2023-02-11 19:54:24,412 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 91920e03fd524f4120fe99584949959d in 442ms, sequenceid=9, compaction requested=false 2023-02-11 19:54:24,413 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 91920e03fd524f4120fe99584949959d: 2023-02-11 19:54:24,413 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d. 2023-02-11 19:54:24,413 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 19:54:24,413 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 19:54:24,413 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:24,413 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-11 19:54:24,413 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-11 19:54:24,415 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:24,415 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:24,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:24,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:24,415 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,415 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:24,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:24,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:24,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:24,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:24,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-11 19:54:24,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d593e15[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:24,416 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-11 19:54:24,417 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,421 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,421 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-11 19:54:24,421 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-11 19:54:24,421 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:24,422 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:24,422 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:24,423 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:24,423 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-11 19:54:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:24,423 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:24,423 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-11 19:54:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:24,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:24,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:24,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:24,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:24,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:24,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-11 19:54:24,425 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-11 19:54:24,425 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:24,425 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:24,425 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,425 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:24,427 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,427 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:24,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:24,427 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:24,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:24,427 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:24,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:24,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:24,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:24,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:24,429 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:24,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:24,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:24,431 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:24,431 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:24,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-11 19:54:24,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:24,431 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:24,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:24,431 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:24,431 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:24,431 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:24,431 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,432 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:24,432 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:24,432 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,432 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,432 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:24,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:24,532 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:24,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:24,539 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40445] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-02-11 19:54:24,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-11 19:54:24,541 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-11 19:54:24,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:54:24,542 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676145864542 2023-02-11 19:54:24,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 19:54:24,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-02-11 19:54:24,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-11 19:54:24,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] zookeeper.ReadOnlyZKClient(139): Connect 0x00d2265a to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:54:24,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@297ffff2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:54:24,547 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230211 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-11 19:54:25,374 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211cab05ae95c604e99add424e9ce6f8410 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230211cab05ae95c604e99add424e9ce6f8410 2023-02-11 19:54:25,374 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-11 19:54:25,389 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:54:25,390 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38542, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:54:25,397 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:54:25,399 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49968, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:54:25,412 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230211/family1/ebaecc8f80a64d759156497981a6e9ab first=Optional[k0] last=Optional[k1] 2023-02-11 19:54:25,412 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230211/family1/ebaecc8f80a64d759156497981a6e9ab}] 2023-02-11 19:54:25,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230211/family1/ebaecc8f80a64d759156497981a6e9ab for inclusion in 91920e03fd524f4120fe99584949959d/family1 2023-02-11 19:54:25,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-02-11 19:54:25,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-11 19:54:25,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 91920e03fd524f4120fe99584949959d: 2023-02-11 19:54:25,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230211/family1/ebaecc8f80a64d759156497981a6e9ab to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testScannerOnBulkLoadRefHFiles__b6n5s3dvc9f88q3frgqokgprp3rgqm10tknih79if1jc3p27auab04gnplns2ip6/family1/ebaecc8f80a64d759156497981a6e9ab 2023-02-11 19:54:25,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testScannerOnBulkLoadRefHFiles__b6n5s3dvc9f88q3frgqokgprp3rgqm10tknih79if1jc3p27auab04gnplns2ip6/family1/ebaecc8f80a64d759156497981a6e9ab as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family1/5efd7037b2ef4a0a8b625b309fb2d1cf_SeqId_12_ 2023-02-11 19:54:25,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testScannerOnBulkLoadRefHFiles__b6n5s3dvc9f88q3frgqokgprp3rgqm10tknih79if1jc3p27auab04gnplns2ip6/family1/ebaecc8f80a64d759156497981a6e9ab into 91920e03fd524f4120fe99584949959d/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family1/5efd7037b2ef4a0a8b625b309fb2d1cf_SeqId_12_ - updating store file list. 2023-02-11 19:54:25,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family1/5efd7037b2ef4a0a8b625b309fb2d1cf_SeqId_12_ into 91920e03fd524f4120fe99584949959d/family1 2023-02-11 19:54:25,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testScannerOnBulkLoadRefHFiles__b6n5s3dvc9f88q3frgqokgprp3rgqm10tknih79if1jc3p27auab04gnplns2ip6/family1/ebaecc8f80a64d759156497981a6e9ab into 91920e03fd524f4120fe99584949959d/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family1/5efd7037b2ef4a0a8b625b309fb2d1cf_SeqId_12_) 2023-02-11 19:54:25,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testScannerOnBulkLoadRefHFiles__b6n5s3dvc9f88q3frgqokgprp3rgqm10tknih79if1jc3p27auab04gnplns2ip6/family1/ebaecc8f80a64d759156497981a6e9ab 2023-02-11 19:54:25,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-11 19:54:25,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-11 19:54:25,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(1912): 91920e03fd524f4120fe99584949959d/family1 is initiating minor compaction (all files) 2023-02-11 19:54:25,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@74291169; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:54:25,432 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 91920e03fd524f4120fe99584949959d/family1 in testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d. 2023-02-11 19:54:25,432 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family1/1eebb874b63749bb89cc5e69b574a62a, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family1/79ac421465ee4699a0584be8de54088a, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family1/5efd7037b2ef4a0a8b625b309fb2d1cf_SeqId_12_] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/.tmp, totalSize=15.1 K 2023-02-11 19:54:25,433 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 1eebb874b63749bb89cc5e69b574a62a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145262991 2023-02-11 19:54:25,433 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 79ac421465ee4699a0584be8de54088a, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145262991 2023-02-11 19:54:25,434 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 5efd7037b2ef4a0a8b625b309fb2d1cf_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145262991 2023-02-11 19:54:25,434 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-11 19:54:25,435 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:54:25,437 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302118dbe63f8e3f3454383f093177623b0c4 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302118dbe63f8e3f3454383f093177623b0c4 2023-02-11 19:54:25,438 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230211a83436683f8f47e5b474ca1fdb246d98 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230211a83436683f8f47e5b474ca1fdb246d98 2023-02-11 19:54:25,438 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-02-11 19:54:25,438 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230211' 2023-02-11 19:54:25,439 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230211 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-11 19:54:25,439 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-11 19:54:25,439 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:54:25,441 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-11 19:54:25,443 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 901 msec 2023-02-11 19:54:25,445 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] throttle.PressureAwareThroughputController(145): 91920e03fd524f4120fe99584949959d#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:54:25,475 INFO [Listener at localhost/32929] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=253 (was 253), OpenFileDescriptor=600 (was 596) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=377 (was 409), ProcessCount=168 (was 168), AvailableMemoryMB=3705 (was 3766) 2023-02-11 19:54:25,487 INFO [Listener at localhost/32929] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=253, OpenFileDescriptor=600, MaxFileDescriptor=60000, SystemLoadAverage=377, ProcessCount=168, AvailableMemoryMB=3705 2023-02-11 19:54:25,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-11 19:54:25,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:25,491 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:54:25,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-02-11 19:54:25,491 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:54:25,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-11 19:54:25,493 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc 2023-02-11 19:54:25,493 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc empty. 2023-02-11 19:54:25,494 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc 2023-02-11 19:54:25,494 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-02-11 19:54:25,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-11 19:54:25,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-11 19:54:25,902 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-11 19:54:25,903 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3b84089ed749a7da100e5f757b3cd2dc, NAME => 'testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp 2023-02-11 19:54:26,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-11 19:54:26,308 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:54:26,309 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing 3b84089ed749a7da100e5f757b3cd2dc, disabling compactions & flushes 2023-02-11 19:54:26,309 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:26,309 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:26,309 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. after waiting 0 ms 2023-02-11 19:54:26,309 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:26,309 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:26,309 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 3b84089ed749a7da100e5f757b3cd2dc: Waiting for close lock at 1676145266309Disabling compacts and flushes for region at 1676145266309Disabling writes for close at 1676145266309Writing region close event to WAL at 1676145266309Closed at 1676145266309 2023-02-11 19:54:26,311 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:54:26,312 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676145266312"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145266312"}]},"ts":"1676145266312"} 2023-02-11 19:54:26,313 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 19:54:26,314 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:54:26,314 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145266314"}]},"ts":"1676145266314"} 2023-02-11 19:54:26,315 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-11 19:54:26,318 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=3b84089ed749a7da100e5f757b3cd2dc, ASSIGN}] 2023-02-11 19:54:26,320 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=3b84089ed749a7da100e5f757b3cd2dc, ASSIGN 2023-02-11 19:54:26,321 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=3b84089ed749a7da100e5f757b3cd2dc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=false 2023-02-11 19:54:26,472 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=3b84089ed749a7da100e5f757b3cd2dc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:26,473 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676145266472"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145266472"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145266472"}]},"ts":"1676145266472"} 2023-02-11 19:54:26,474 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 3b84089ed749a7da100e5f757b3cd2dc, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:54:26,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-11 19:54:26,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:26,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3b84089ed749a7da100e5f757b3cd2dc, NAME => 'testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:54:26,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 3b84089ed749a7da100e5f757b3cd2dc 2023-02-11 19:54:26,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:54:26,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3b84089ed749a7da100e5f757b3cd2dc 2023-02-11 19:54:26,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3b84089ed749a7da100e5f757b3cd2dc 2023-02-11 19:54:26,632 INFO [StoreOpener-3b84089ed749a7da100e5f757b3cd2dc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3b84089ed749a7da100e5f757b3cd2dc 2023-02-11 19:54:26,633 DEBUG [StoreOpener-3b84089ed749a7da100e5f757b3cd2dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1 2023-02-11 19:54:26,634 DEBUG [StoreOpener-3b84089ed749a7da100e5f757b3cd2dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1 2023-02-11 19:54:26,634 INFO [StoreOpener-3b84089ed749a7da100e5f757b3cd2dc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b84089ed749a7da100e5f757b3cd2dc columnFamilyName family1 2023-02-11 19:54:26,635 INFO [StoreOpener-3b84089ed749a7da100e5f757b3cd2dc-1] regionserver.HStore(310): Store=3b84089ed749a7da100e5f757b3cd2dc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:54:26,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc 2023-02-11 19:54:26,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc 2023-02-11 19:54:26,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3b84089ed749a7da100e5f757b3cd2dc 2023-02-11 19:54:26,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:54:26,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3b84089ed749a7da100e5f757b3cd2dc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66304093, jitterRate=-0.011992022395133972}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:54:26,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3b84089ed749a7da100e5f757b3cd2dc: Running coprocessor pre-open hook at 1676145266631Writing region info on filesystem at 1676145266631Initializing all the Stores at 1676145266631Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676145266632 (+1 ms)Cleaning up temporary data from old regions at 1676145266638 (+6 ms)Cleaning up detritus from prior splits at 1676145266638Running coprocessor post-open hooks at 1676145266644 (+6 ms)Region opened successfully at 1676145266644 2023-02-11 19:54:26,645 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc., pid=37, masterSystemTime=1676145266626 2023-02-11 19:54:26,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:26,646 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:26,647 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=3b84089ed749a7da100e5f757b3cd2dc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:26,647 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676145266647"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145266647"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145266647"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145266647"}]},"ts":"1676145266647"} 2023-02-11 19:54:26,650 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-02-11 19:54:26,650 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 3b84089ed749a7da100e5f757b3cd2dc, server=jenkins-hbase4.apache.org,45897,1676145215747 in 174 msec 2023-02-11 19:54:26,652 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-02-11 19:54:26,652 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=3b84089ed749a7da100e5f757b3cd2dc, ASSIGN in 332 msec 2023-02-11 19:54:26,653 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:54:26,653 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145266653"}]},"ts":"1676145266653"} 2023-02-11 19:54:26,654 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-11 19:54:26,656 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:54:26,657 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1670 sec 2023-02-11 19:54:26,670 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/.tmp/family1/c16747361b9942eea81331bff2037209 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family1/c16747361b9942eea81331bff2037209 2023-02-11 19:54:26,676 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 91920e03fd524f4120fe99584949959d/family1 of 91920e03fd524f4120fe99584949959d into c16747361b9942eea81331bff2037209(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 19:54:26,676 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 91920e03fd524f4120fe99584949959d: 2023-02-11 19:54:26,676 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1676145265432; duration=1sec 2023-02-11 19:54:26,676 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:54:26,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family1/1eebb874b63749bb89cc5e69b574a62a, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family1/79ac421465ee4699a0584be8de54088a, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family1/5efd7037b2ef4a0a8b625b309fb2d1cf_SeqId_12_] to archive 2023-02-11 19:54:26,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:54:26,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family1/1eebb874b63749bb89cc5e69b574a62a to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family1/1eebb874b63749bb89cc5e69b574a62a 2023-02-11 19:54:26,725 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family1/79ac421465ee4699a0584be8de54088a to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family1/79ac421465ee4699a0584be8de54088a 2023-02-11 19:54:26,726 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family1/5efd7037b2ef4a0a8b625b309fb2d1cf_SeqId_12_ to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/family1/5efd7037b2ef4a0a8b625b309fb2d1cf_SeqId_12_ 2023-02-11 19:54:27,575 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 19:54:27,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-11 19:54:27,597 INFO [Listener at localhost/32929] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-02-11 19:54:27,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:27,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:27,618 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 19:54:27,618 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:27,618 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 19:54:27,618 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:27,619 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:27,619 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:27,625 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:27,625 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:27,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:27,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:27,626 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:27,626 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:27,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:27,626 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:27,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:27,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:27,626 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:27,627 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:27,627 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 19:54:27,627 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:27,627 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 19:54:27,627 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:27,627 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:27,627 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:27,627 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. started... 2023-02-11 19:54:27,628 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3b84089ed749a7da100e5f757b3cd2dc 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-11 19:54:28,045 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113027d3eda5596244f8840f8e003938b839 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113027d3eda5596244f8840f8e003938b839 2023-02-11 19:54:28,049 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp/family1/b56737bfe2924a07ad88c9274360cd57 2023-02-11 19:54:28,054 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp/family1/b56737bfe2924a07ad88c9274360cd57 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/b56737bfe2924a07ad88c9274360cd57 2023-02-11 19:54:28,060 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/b56737bfe2924a07ad88c9274360cd57, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-11 19:54:28,061 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 3b84089ed749a7da100e5f757b3cd2dc in 432ms, sequenceid=5, compaction requested=false 2023-02-11 19:54:28,061 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 19:54:28,061 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3b84089ed749a7da100e5f757b3cd2dc: 2023-02-11 19:54:28,061 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:28,061 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:28,061 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:28,061 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:28,062 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 19:54:28,062 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 19:54:28,066 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:28,066 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:28,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:28,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:28,066 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,066 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:28,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:28,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:28,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:28,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:28,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 19:54:28,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32adb015[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:28,068 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:28,068 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,069 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,069 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:28,069 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 19:54:28,069 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:28,070 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:28,070 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:28,071 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:28,071 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 19:54:28,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:28,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:28,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:28,071 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:28,072 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 19:54:28,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:28,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:28,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:28,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:28,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:28,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:28,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:28,075 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 19:54:28,075 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:28,075 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:28,075 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,075 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:28,077 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,077 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:28,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,077 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:28,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:28,077 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:28,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,079 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:28,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:28,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:28,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:28,081 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:28,081 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:28,081 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:28,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:28,082 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,081 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:28,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 19:54:28,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:28,081 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:28,082 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:28,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:28,082 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,082 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,082 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 19:54:28,082 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:28,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:28,082 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:28,182 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:28,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:28,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:28,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:28,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,189 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 19:54:28,189 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:28,189 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 19:54:28,189 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:28,189 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,189 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,190 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:28,190 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:28,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:28,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:28,191 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:28,191 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:28,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,191 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:28,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,192 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,192 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 19:54:28,192 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:28,192 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 19:54:28,192 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:28,192 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 19:54:28,192 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:28,192 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:28,192 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:28,192 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. started... 2023-02-11 19:54:28,192 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3b84089ed749a7da100e5f757b3cd2dc 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-11 19:54:28,605 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128ab932267acd4476b93870757e9a3b12c to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128ab932267acd4476b93870757e9a3b12c 2023-02-11 19:54:29,011 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp/family1/ce91fbf213154ed0ac158bf01e364131 2023-02-11 19:54:29,016 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp/family1/ce91fbf213154ed0ac158bf01e364131 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/ce91fbf213154ed0ac158bf01e364131 2023-02-11 19:54:29,020 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/ce91fbf213154ed0ac158bf01e364131, entries=1, sequenceid=9, filesize=5.0 K 2023-02-11 19:54:29,021 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 3b84089ed749a7da100e5f757b3cd2dc in 828ms, sequenceid=9, compaction requested=false 2023-02-11 19:54:29,021 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3b84089ed749a7da100e5f757b3cd2dc: 2023-02-11 19:54:29,021 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:29,021 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:29,021 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:29,021 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,021 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 19:54:29,021 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 19:54:29,023 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,023 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:29,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:29,023 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,023 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:29,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:29,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:29,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:29,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 19:54:29,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b9ff03d[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:29,025 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:29,025 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,026 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,026 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:29,026 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,026 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:29,026 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 19:54:29,027 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:29,032 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,032 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 19:54:29,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:29,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:29,032 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:29,032 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 19:54:29,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:29,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:29,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:29,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:29,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:29,034 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 19:54:29,034 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:29,034 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:29,034 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,034 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:29,035 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,035 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:29,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:29,036 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:29,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:29,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:29,036 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:29,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:29,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,037 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:29,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,039 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,039 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,039 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:29,039 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,039 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:29,039 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:29,039 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 19:54:29,039 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:29,039 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 19:54:29,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:29,040 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:29,040 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,040 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:29,040 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:29,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:29,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:29,140 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:29,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:29,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:29,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:29,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,147 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 19:54:29,147 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:29,147 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 19:54:29,147 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:29,148 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,148 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,150 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:29,150 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:29,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:29,150 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,150 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:29,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:29,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,151 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,151 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 19:54:29,151 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,151 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 19:54:29,151 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:29,151 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 19:54:29,151 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:29,152 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:29,152 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:29,152 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. started... 2023-02-11 19:54:29,152 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3b84089ed749a7da100e5f757b3cd2dc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:29,564 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201a9c8367798164fce95f5fd8fa8286420 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201a9c8367798164fce95f5fd8fa8286420 2023-02-11 19:54:29,970 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp/family1/6996e60633994ac8b7d1a4896f0a7f07 2023-02-11 19:54:29,975 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp/family1/6996e60633994ac8b7d1a4896f0a7f07 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/6996e60633994ac8b7d1a4896f0a7f07 2023-02-11 19:54:29,979 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/6996e60633994ac8b7d1a4896f0a7f07, entries=1, sequenceid=13, filesize=4.9 K 2023-02-11 19:54:29,980 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b84089ed749a7da100e5f757b3cd2dc in 828ms, sequenceid=13, compaction requested=true 2023-02-11 19:54:29,980 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3b84089ed749a7da100e5f757b3cd2dc: 2023-02-11 19:54:29,980 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:29,980 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:29,980 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:29,980 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,980 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 19:54:29,980 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 19:54:29,982 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,982 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:29,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:29,982 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,982 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:29,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:29,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:29,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:29,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 19:54:29,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2403edb0[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:29,983 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:29,984 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,986 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,986 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:29,986 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 19:54:29,986 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:29,986 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,986 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:29,987 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 19:54:29,987 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,987 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:29,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:29,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:29,987 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 19:54:29,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:29,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:29,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:29,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:29,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:29,989 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 19:54:29,989 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:29,989 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:29,989 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,989 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:29,991 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,991 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:29,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:29,991 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:29,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:29,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:29,991 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:29,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:29,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,992 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:29,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,994 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,994 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,994 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:29,994 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:29,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 19:54:29,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:29,995 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:29,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 19:54:29,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:29,995 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:29,995 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:29,995 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,995 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:29,995 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:29,995 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:29,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:29,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:29,995 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,095 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:30,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:30,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:30,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:30,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,102 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 19:54:30,102 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:30,102 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 19:54:30,102 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:30,102 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,102 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,103 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:30,104 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:30,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:30,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:30,104 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:30,104 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:30,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:30,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,105 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,105 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 19:54:30,105 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,105 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 19:54:30,105 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:30,105 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 19:54:30,105 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:30,105 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:30,105 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:30,105 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. started... 2023-02-11 19:54:30,105 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3b84089ed749a7da100e5f757b3cd2dc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:30,518 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205d3253792a74e4dc89001be0fbf71d396 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205d3253792a74e4dc89001be0fbf71d396 2023-02-11 19:54:30,928 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp/family1/da298c268d0345d79576c3efcf857852 2023-02-11 19:54:30,933 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp/family1/da298c268d0345d79576c3efcf857852 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/da298c268d0345d79576c3efcf857852 2023-02-11 19:54:30,937 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/da298c268d0345d79576c3efcf857852, entries=1, sequenceid=17, filesize=4.9 K 2023-02-11 19:54:30,938 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b84089ed749a7da100e5f757b3cd2dc in 833ms, sequenceid=17, compaction requested=true 2023-02-11 19:54:30,938 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3b84089ed749a7da100e5f757b3cd2dc: 2023-02-11 19:54:30,938 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:30,938 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:30,938 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:30,938 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:30,938 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 19:54:30,939 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 19:54:30,940 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:30,940 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:30,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:30,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:30,940 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,941 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:30,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:30,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:30,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:30,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:30,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 19:54:30,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8ec6b3[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:30,942 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:30,942 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,943 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,943 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:30,943 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 19:54:30,943 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:30,943 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:30,943 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:30,945 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 19:54:30,945 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:30,945 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:30,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:30,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:30,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:30,945 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 19:54:30,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:30,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:30,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:30,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:30,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:30,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:30,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:30,947 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 19:54:30,947 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:30,947 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:30,947 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,947 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:30,949 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,949 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:30,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:30,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,949 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:30,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:30,950 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:30,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:30,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:30,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:30,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,951 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:30,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:30,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:30,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:30,953 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:30,953 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,953 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,953 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:30,953 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,953 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:30,953 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,953 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:30,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 19:54:30,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:30,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:30,953 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 19:54:30,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:30,953 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:30,953 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:30,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:30,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:30,954 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:30,954 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:31,054 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:31,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:31,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:31,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:31,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,060 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 19:54:31,060 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:31,060 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 19:54:31,060 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:31,061 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,061 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,062 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:31,062 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:31,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:31,062 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:31,062 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:31,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,063 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,063 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 19:54:31,063 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,063 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 19:54:31,063 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:31,063 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 19:54:31,064 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:31,064 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:31,064 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:31,064 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. started... 2023-02-11 19:54:31,064 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3b84089ed749a7da100e5f757b3cd2dc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:31,477 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228d61e35bab9734f9092b331e70c0cccb0 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228d61e35bab9734f9092b331e70c0cccb0 2023-02-11 19:54:31,883 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp/family1/8b17bb5e0d4044b8896baa46ba0b27a1 2023-02-11 19:54:31,888 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp/family1/8b17bb5e0d4044b8896baa46ba0b27a1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/8b17bb5e0d4044b8896baa46ba0b27a1 2023-02-11 19:54:31,892 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/8b17bb5e0d4044b8896baa46ba0b27a1, entries=1, sequenceid=21, filesize=4.9 K 2023-02-11 19:54:31,893 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b84089ed749a7da100e5f757b3cd2dc in 829ms, sequenceid=21, compaction requested=true 2023-02-11 19:54:31,893 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3b84089ed749a7da100e5f757b3cd2dc: 2023-02-11 19:54:31,893 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:31,893 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:31,893 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:31,893 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:31,893 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 19:54:31,893 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 19:54:31,900 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:31,900 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:31,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:31,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:31,900 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,900 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:31,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:31,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:31,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:31,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:31,901 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 19:54:31,901 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f7ce3af[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:31,901 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:31,901 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,902 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,902 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:31,902 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 19:54:31,902 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:31,902 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:31,902 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:31,904 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 19:54:31,904 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:31,904 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:31,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:31,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:31,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:31,904 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 19:54:31,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:31,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:31,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:31,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:31,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:31,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:31,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:31,906 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 19:54:31,906 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:31,906 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:31,906 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,906 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:31,907 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,907 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:31,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:31,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,908 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:31,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:31,908 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:31,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:31,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:31,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:31,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,909 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:31,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:31,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:31,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:31,912 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:31,912 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:31,913 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,913 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:31,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:31,913 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 19:54:31,913 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:31,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:31,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 19:54:31,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:31,913 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,913 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:31,913 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,913 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,913 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:31,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:31,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:31,913 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:31,913 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:32,013 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:32,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:32,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:32,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:32,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,020 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 19:54:32,020 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:32,020 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 19:54:32,020 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:32,020 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,020 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,022 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:32,022 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:32,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:32,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:32,022 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:32,022 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:32,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:32,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,023 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,023 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 19:54:32,023 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,023 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 19:54:32,023 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:32,023 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 19:54:32,023 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:32,023 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:32,023 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:32,023 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. started... 2023-02-11 19:54:32,023 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3b84089ed749a7da100e5f757b3cd2dc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:32,435 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231efdd3841050644a3a3f5f882dd9e6bf9 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231efdd3841050644a3a3f5f882dd9e6bf9 2023-02-11 19:54:32,840 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp/family1/0fb118e153cf4104a61729e51fd5685f 2023-02-11 19:54:32,846 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp/family1/0fb118e153cf4104a61729e51fd5685f as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/0fb118e153cf4104a61729e51fd5685f 2023-02-11 19:54:32,850 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/0fb118e153cf4104a61729e51fd5685f, entries=1, sequenceid=25, filesize=4.9 K 2023-02-11 19:54:32,850 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b84089ed749a7da100e5f757b3cd2dc in 827ms, sequenceid=25, compaction requested=true 2023-02-11 19:54:32,851 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3b84089ed749a7da100e5f757b3cd2dc: 2023-02-11 19:54:32,851 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:32,851 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:32,851 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:32,851 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:32,851 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 19:54:32,851 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 19:54:32,853 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:32,853 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:32,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:32,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:32,853 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,853 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:32,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:32,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:32,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:32,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:32,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 19:54:32,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b76ee65[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:32,854 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:32,854 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,855 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,856 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:32,856 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 19:54:32,856 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:32,856 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:32,856 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:32,860 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 19:54:32,860 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:32,860 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:32,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:32,860 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 19:54:32,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:32,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:32,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:32,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:32,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:32,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:32,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:32,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:32,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:32,862 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 19:54:32,862 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:32,862 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:32,862 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,862 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:32,864 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,864 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,864 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:32,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:32,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:32,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:32,864 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:32,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:32,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:32,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:32,865 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:32,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:32,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:32,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:32,868 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:32,868 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:32,868 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:32,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 19:54:32,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:32,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:32,868 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:32,868 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,868 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:32,868 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:32,868 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 19:54:32,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:32,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:32,868 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,868 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:32,868 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:32,868 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,969 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:32,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:32,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:32,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:32,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,975 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 19:54:32,975 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:32,975 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 19:54:32,975 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:32,975 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,975 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,977 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:32,977 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:32,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:32,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:32,977 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:32,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,977 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:32,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:32,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,978 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,978 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 19:54:32,978 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:32,978 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 19:54:32,978 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:32,978 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 19:54:32,978 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:32,978 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:32,978 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:32,978 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. started... 2023-02-11 19:54:32,978 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3b84089ed749a7da100e5f757b3cd2dc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:33,391 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101a3e2b6aa0be64cadac7680945f162277 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101a3e2b6aa0be64cadac7680945f162277 2023-02-11 19:54:33,796 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp/family1/a8e194116cc5405da3ed3d417fe261fe 2023-02-11 19:54:33,801 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp/family1/a8e194116cc5405da3ed3d417fe261fe as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/a8e194116cc5405da3ed3d417fe261fe 2023-02-11 19:54:33,805 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/a8e194116cc5405da3ed3d417fe261fe, entries=1, sequenceid=29, filesize=4.9 K 2023-02-11 19:54:33,806 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b84089ed749a7da100e5f757b3cd2dc in 828ms, sequenceid=29, compaction requested=true 2023-02-11 19:54:33,806 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3b84089ed749a7da100e5f757b3cd2dc: 2023-02-11 19:54:33,806 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:33,806 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:33,806 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:33,806 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:33,806 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 19:54:33,806 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 19:54:33,809 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:33,809 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:33,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:33,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:33,809 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,809 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:33,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:33,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:33,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:33,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:33,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 19:54:33,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70a3e4d6[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:33,811 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:33,811 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,812 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,812 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:33,812 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:33,812 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:33,812 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 19:54:33,812 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:33,813 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 19:54:33,813 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:33,813 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:33,813 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 19:54:33,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:33,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:33,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:33,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:33,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:33,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:33,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:33,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:33,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:33,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:33,815 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 19:54:33,816 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:33,816 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:33,816 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,816 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:33,817 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,817 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:33,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:33,817 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:33,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:33,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:33,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:33,818 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:33,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:33,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,819 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:33,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:33,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:33,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:33,822 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:33,822 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:33,822 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:33,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 19:54:33,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:33,822 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:33,822 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,822 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:33,822 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:33,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:33,822 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,822 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,822 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:33,823 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:33,823 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:33,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:33,923 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:33,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:33,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:33,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:33,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,929 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 19:54:33,929 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:33,929 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 19:54:33,929 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:33,930 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,930 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,934 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:33,934 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:33,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:33,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:33,934 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:33,934 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:33,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:33,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,935 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,935 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 19:54:33,935 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:33,935 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 19:54:33,935 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:33,935 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 19:54:33,935 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:33,935 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:33,935 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:33,935 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. started... 2023-02-11 19:54:33,935 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3b84089ed749a7da100e5f757b3cd2dc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:34,348 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010320c5a597fab44237b345b7db12dc8815 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010320c5a597fab44237b345b7db12dc8815 2023-02-11 19:54:34,753 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp/family1/f9f4d9fcb40149a89498709c663e092b 2023-02-11 19:54:34,758 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp/family1/f9f4d9fcb40149a89498709c663e092b as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/f9f4d9fcb40149a89498709c663e092b 2023-02-11 19:54:34,762 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/f9f4d9fcb40149a89498709c663e092b, entries=1, sequenceid=33, filesize=4.9 K 2023-02-11 19:54:34,763 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b84089ed749a7da100e5f757b3cd2dc in 828ms, sequenceid=33, compaction requested=true 2023-02-11 19:54:34,763 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3b84089ed749a7da100e5f757b3cd2dc: 2023-02-11 19:54:34,763 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:34,763 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:34,763 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:34,763 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:34,763 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 19:54:34,763 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 19:54:34,764 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:34,764 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:34,765 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,765 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:34,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 19:54:34,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ee1f2f[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:34,766 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:34,766 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,771 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,771 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:34,771 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 19:54:34,771 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:34,771 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:34,771 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:34,773 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 19:54:34,773 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:34,773 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:34,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:34,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:34,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:34,773 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 19:54:34,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:34,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:34,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:34,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:34,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:34,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:34,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:34,775 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 19:54:34,775 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:34,775 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:34,775 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,775 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:34,776 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,776 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:34,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:34,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,776 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:34,777 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:34,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:34,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,778 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:34,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:34,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:34,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:34,780 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:34,780 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:34,780 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:34,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 19:54:34,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:34,780 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:34,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:34,780 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:34,780 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 19:54:34,780 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,780 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:34,781 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:34,781 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:34,781 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,781 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,781 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:34,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:34,881 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:34,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:34,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:34,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:34,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,887 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 19:54:34,887 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:34,887 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 19:54:34,887 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:34,888 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,888 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,890 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:34,890 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:34,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:34,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:34,891 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:34,891 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:34,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,891 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:34,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,891 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,892 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 19:54:34,892 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:34,892 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 19:54:34,892 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:34,892 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 19:54:34,892 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:34,892 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:34,892 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:34,892 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. started... 2023-02-11 19:54:34,892 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3b84089ed749a7da100e5f757b3cd2dc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:35,305 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509077478cd5404f84f5da7c41c53d201d969 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201509077478cd5404f84f5da7c41c53d201d969 2023-02-11 19:54:35,710 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp/family1/c2826c72579644e8994b917669ee9df7 2023-02-11 19:54:35,715 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp/family1/c2826c72579644e8994b917669ee9df7 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/c2826c72579644e8994b917669ee9df7 2023-02-11 19:54:35,719 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/c2826c72579644e8994b917669ee9df7, entries=1, sequenceid=37, filesize=4.9 K 2023-02-11 19:54:35,720 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b84089ed749a7da100e5f757b3cd2dc in 828ms, sequenceid=37, compaction requested=true 2023-02-11 19:54:35,720 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3b84089ed749a7da100e5f757b3cd2dc: 2023-02-11 19:54:35,720 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:35,721 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:35,721 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:35,721 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:35,721 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 19:54:35,721 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 19:54:35,722 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:35,722 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:35,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:35,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:35,723 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,723 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:35,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:35,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:35,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:35,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:35,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 19:54:35,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e37e5c6[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:35,724 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:35,724 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,725 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,725 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:35,726 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 19:54:35,726 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:35,726 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:35,726 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:35,727 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 19:54:35,727 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:35,727 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:35,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:35,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:35,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:35,727 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 19:54:35,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:35,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:35,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:35,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:35,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:35,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:35,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:35,729 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 19:54:35,729 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:35,729 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:35,729 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,729 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:35,732 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,732 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:35,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:35,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,732 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:35,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:35,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:35,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:35,732 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:35,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:35,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,734 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:35,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:35,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:35,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:35,735 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:35,736 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:35,736 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,736 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:35,736 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:35,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:35,736 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:35,736 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:35,736 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 19:54:35,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 19:54:35,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:35,736 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,736 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,736 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:35,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:35,736 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:35,736 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:35,837 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:35,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:35,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:35,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:35,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,843 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 19:54:35,843 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:35,843 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 19:54:35,843 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 19:54:35,843 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,843 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,845 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:35,845 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:35,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:35,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:35,845 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:35,845 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:35,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,845 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:35,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,846 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,846 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 19:54:35,846 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:35,846 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 19:54:35,846 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:35,846 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 19:54:35,846 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:35,846 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:35,846 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:35,846 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. started... 2023-02-11 19:54:35,847 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3b84089ed749a7da100e5f757b3cd2dc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:36,259 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120c728dc602eef462b845b9c441558e6ca to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120c728dc602eef462b845b9c441558e6ca 2023-02-11 19:54:36,664 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp/family1/e24e42ff8243442e8d18f9a3c8002b63 2023-02-11 19:54:36,669 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp/family1/e24e42ff8243442e8d18f9a3c8002b63 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/e24e42ff8243442e8d18f9a3c8002b63 2023-02-11 19:54:36,673 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/e24e42ff8243442e8d18f9a3c8002b63, entries=1, sequenceid=41, filesize=4.9 K 2023-02-11 19:54:36,674 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b84089ed749a7da100e5f757b3cd2dc in 828ms, sequenceid=41, compaction requested=true 2023-02-11 19:54:36,674 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3b84089ed749a7da100e5f757b3cd2dc: 2023-02-11 19:54:36,674 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:36,674 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:36,674 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:36,674 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:36,674 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 19:54:36,674 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 19:54:36,676 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:36,676 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:36,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:36,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:36,676 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:36,676 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:36,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:36,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:36,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:36,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 19:54:36,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42ce31a3[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:36,677 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 19:54:36,678 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,680 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,680 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 19:54:36,680 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 19:54:36,680 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:36,680 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:36,680 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:36,681 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 19:54:36,681 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:36,681 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:36,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:36,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:36,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:36,681 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 19:54:36,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:36,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:36,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:36,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:36,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:36,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:36,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:54:36,684 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 19:54:36,684 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:36,684 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:36,684 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,684 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:36,685 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,685 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:36,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:36,685 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:36,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,686 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:36,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:36,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:36,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:36,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:36,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,687 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:36,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:36,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:36,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:36,694 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:36,694 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:36,694 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:36,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 19:54:36,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:36,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 19:54:36,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:36,694 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:36,694 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,694 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:36,694 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:36,694 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:36,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:36,694 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:36,695 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,694 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:36,695 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,795 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:36,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:36,797 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40445] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-02-11 19:54:36,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 19:54:36,799 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 19:54:36,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:54:36,800 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676145876800 2023-02-11 19:54:36,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 19:54:36,803 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-11 19:54:36,803 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 19:54:36,803 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] zookeeper.ReadOnlyZKClient(139): Connect 0x69eef449 to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:54:36,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f3806e9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:54:36,808 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 19:54:37,649 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103aeba4c2dfe474cf885966206872b8054 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103aeba4c2dfe474cf885966206872b8054 2023-02-11 19:54:37,650 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 19:54:37,663 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:54:37,664 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52940, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:54:37,670 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:54:37,671 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41968, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:54:37,680 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9870f6ac5517402da0a251fa150d3b90 first=Optional[r3] last=Optional[r6] 2023-02-11 19:54:37,681 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9870f6ac5517402da0a251fa150d3b90}] 2023-02-11 19:54:37,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9870f6ac5517402da0a251fa150d3b90 for inclusion in 3b84089ed749a7da100e5f757b3cd2dc/family1 2023-02-11 19:54:37,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-11 19:54:37,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 19:54:37,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 3b84089ed749a7da100e5f757b3cd2dc: 2023-02-11 19:54:37,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9870f6ac5517402da0a251fa150d3b90 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyPolicy__nvod02mtf6c1k5jnlofnqrg0rsabaaco9ej4bjh0e8snct0r7he8b9rrebts73ev/family1/9870f6ac5517402da0a251fa150d3b90 2023-02-11 19:54:37,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyPolicy__nvod02mtf6c1k5jnlofnqrg0rsabaaco9ej4bjh0e8snct0r7he8b9rrebts73ev/family1/9870f6ac5517402da0a251fa150d3b90 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/d7e94b52b6c54bd88995c1adfdf9891a_SeqId_44_ 2023-02-11 19:54:37,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyPolicy__nvod02mtf6c1k5jnlofnqrg0rsabaaco9ej4bjh0e8snct0r7he8b9rrebts73ev/family1/9870f6ac5517402da0a251fa150d3b90 into 3b84089ed749a7da100e5f757b3cd2dc/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/d7e94b52b6c54bd88995c1adfdf9891a_SeqId_44_ - updating store file list. 2023-02-11 19:54:37,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/d7e94b52b6c54bd88995c1adfdf9891a_SeqId_44_ into 3b84089ed749a7da100e5f757b3cd2dc/family1 2023-02-11 19:54:37,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyPolicy__nvod02mtf6c1k5jnlofnqrg0rsabaaco9ej4bjh0e8snct0r7he8b9rrebts73ev/family1/9870f6ac5517402da0a251fa150d3b90 into 3b84089ed749a7da100e5f757b3cd2dc/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/d7e94b52b6c54bd88995c1adfdf9891a_SeqId_44_) 2023-02-11 19:54:37,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyPolicy__nvod02mtf6c1k5jnlofnqrg0rsabaaco9ej4bjh0e8snct0r7he8b9rrebts73ev/family1/9870f6ac5517402da0a251fa150d3b90 2023-02-11 19:54:37,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-11 19:54:37,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-11 19:54:37,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(1912): 3b84089ed749a7da100e5f757b3cd2dc/family1 is initiating minor compaction 2023-02-11 19:54:37,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@604fec5d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:54:37,702 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 3b84089ed749a7da100e5f757b3cd2dc/family1 in testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:37,703 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/ce91fbf213154ed0ac158bf01e364131, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/6996e60633994ac8b7d1a4896f0a7f07, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/da298c268d0345d79576c3efcf857852, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/8b17bb5e0d4044b8896baa46ba0b27a1, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/0fb118e153cf4104a61729e51fd5685f, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/a8e194116cc5405da3ed3d417fe261fe, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/f9f4d9fcb40149a89498709c663e092b, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/c2826c72579644e8994b917669ee9df7, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/e24e42ff8243442e8d18f9a3c8002b63, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/d7e94b52b6c54bd88995c1adfdf9891a_SeqId_44_] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp, totalSize=50.0 K 2023-02-11 19:54:37,703 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting ce91fbf213154ed0ac158bf01e364131, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 19:54:37,703 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 6996e60633994ac8b7d1a4896f0a7f07, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 19:54:37,703 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting da298c268d0345d79576c3efcf857852, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-11 19:54:37,703 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 8b17bb5e0d4044b8896baa46ba0b27a1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-11 19:54:37,703 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 0fb118e153cf4104a61729e51fd5685f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-11 19:54:37,703 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting a8e194116cc5405da3ed3d417fe261fe, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-11 19:54:37,703 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting f9f4d9fcb40149a89498709c663e092b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-11 19:54:37,703 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting c2826c72579644e8994b917669ee9df7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-11 19:54:37,703 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting e24e42ff8243442e8d18f9a3c8002b63, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-11 19:54:37,703 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting d7e94b52b6c54bd88995c1adfdf9891a_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-11 19:54:37,704 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 19:54:37,705 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:54:37,707 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228d61e35bab9734f9092b331e70c0cccb0 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228d61e35bab9734f9092b331e70c0cccb0 2023-02-11 19:54:37,708 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231efdd3841050644a3a3f5f882dd9e6bf9 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231efdd3841050644a3a3f5f882dd9e6bf9 2023-02-11 19:54:37,709 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101a3e2b6aa0be64cadac7680945f162277 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101a3e2b6aa0be64cadac7680945f162277 2023-02-11 19:54:37,711 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010320c5a597fab44237b345b7db12dc8815 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010320c5a597fab44237b345b7db12dc8815 2023-02-11 19:54:37,711 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-11 19:54:37,711 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-11 19:54:37,712 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 19:54:37,712 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 19:54:37,712 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 19:54:37,712 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 19:54:37,712 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 19:54:37,712 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 19:54:37,712 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 19:54:37,712 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 19:54:37,746 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3b84089ed749a7da100e5f757b3cd2dc#family1#compaction#49 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-02-11 19:54:38,585 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:54:38,585 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00d2265a to 127.0.0.1:64025 2023-02-11 19:54:38,585 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:54:38,588 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:54:38,588 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7560e6ec to 127.0.0.1:64025 2023-02-11 19:54:38,588 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:54:38,592 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:54:38,592 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4cf470c6 to 127.0.0.1:64025 2023-02-11 19:54:38,592 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:54:38,595 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp/family1/4603d6241e9a4228923ce7e53399855e as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/4603d6241e9a4228923ce7e53399855e 2023-02-11 19:54:38,597 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205710a780160fd46d3ac0cff7ecb8c5ca6 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205710a780160fd46d3ac0cff7ecb8c5ca6 2023-02-11 19:54:38,598 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 19:54:38,599 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 3b84089ed749a7da100e5f757b3cd2dc/family1 of 3b84089ed749a7da100e5f757b3cd2dc into 4603d6241e9a4228923ce7e53399855e(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 19:54:38,599 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 3b84089ed749a7da100e5f757b3cd2dc: 2023-02-11 19:54:38,600 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1676145277702; duration=0sec 2023-02-11 19:54:38,600 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:54:38,629 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/ce91fbf213154ed0ac158bf01e364131, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/6996e60633994ac8b7d1a4896f0a7f07, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/da298c268d0345d79576c3efcf857852, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/8b17bb5e0d4044b8896baa46ba0b27a1, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/0fb118e153cf4104a61729e51fd5685f, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/a8e194116cc5405da3ed3d417fe261fe, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/f9f4d9fcb40149a89498709c663e092b, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/c2826c72579644e8994b917669ee9df7, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/e24e42ff8243442e8d18f9a3c8002b63, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/d7e94b52b6c54bd88995c1adfdf9891a_SeqId_44_] to archive 2023-02-11 19:54:38,630 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:54:38,630 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a62a65dfbf5043f39ff3c9375d9b5cad first=Optional[r00] last=Optional[r2] 2023-02-11 19:54:38,631 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a62a65dfbf5043f39ff3c9375d9b5cad}] 2023-02-11 19:54:38,632 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/ce91fbf213154ed0ac158bf01e364131 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/ce91fbf213154ed0ac158bf01e364131 2023-02-11 19:54:38,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a62a65dfbf5043f39ff3c9375d9b5cad for inclusion in 3b84089ed749a7da100e5f757b3cd2dc/family1 2023-02-11 19:54:38,633 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/6996e60633994ac8b7d1a4896f0a7f07 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/6996e60633994ac8b7d1a4896f0a7f07 2023-02-11 19:54:38,634 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/da298c268d0345d79576c3efcf857852 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/da298c268d0345d79576c3efcf857852 2023-02-11 19:54:38,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-11 19:54:38,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 19:54:38,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 3b84089ed749a7da100e5f757b3cd2dc: 2023-02-11 19:54:38,635 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/8b17bb5e0d4044b8896baa46ba0b27a1 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/8b17bb5e0d4044b8896baa46ba0b27a1 2023-02-11 19:54:38,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a62a65dfbf5043f39ff3c9375d9b5cad to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyPolicy__j09pbia3gut4qt0uplcootq0tpolin3tjr0rkb9itggo1olouc5rp2r7p77rkbqu/family1/a62a65dfbf5043f39ff3c9375d9b5cad 2023-02-11 19:54:38,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/0fb118e153cf4104a61729e51fd5685f to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/0fb118e153cf4104a61729e51fd5685f 2023-02-11 19:54:38,638 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/a8e194116cc5405da3ed3d417fe261fe to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/a8e194116cc5405da3ed3d417fe261fe 2023-02-11 19:54:38,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyPolicy__j09pbia3gut4qt0uplcootq0tpolin3tjr0rkb9itggo1olouc5rp2r7p77rkbqu/family1/a62a65dfbf5043f39ff3c9375d9b5cad as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/20ff06ee0c9f401ab2b5147041d9206a_SeqId_47_ 2023-02-11 19:54:38,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyPolicy__j09pbia3gut4qt0uplcootq0tpolin3tjr0rkb9itggo1olouc5rp2r7p77rkbqu/family1/a62a65dfbf5043f39ff3c9375d9b5cad into 3b84089ed749a7da100e5f757b3cd2dc/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/20ff06ee0c9f401ab2b5147041d9206a_SeqId_47_ - updating store file list. 2023-02-11 19:54:38,639 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/f9f4d9fcb40149a89498709c663e092b to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/f9f4d9fcb40149a89498709c663e092b 2023-02-11 19:54:38,640 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/c2826c72579644e8994b917669ee9df7 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/c2826c72579644e8994b917669ee9df7 2023-02-11 19:54:38,642 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/e24e42ff8243442e8d18f9a3c8002b63 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/e24e42ff8243442e8d18f9a3c8002b63 2023-02-11 19:54:38,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/20ff06ee0c9f401ab2b5147041d9206a_SeqId_47_ into 3b84089ed749a7da100e5f757b3cd2dc/family1 2023-02-11 19:54:38,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyPolicy__j09pbia3gut4qt0uplcootq0tpolin3tjr0rkb9itggo1olouc5rp2r7p77rkbqu/family1/a62a65dfbf5043f39ff3c9375d9b5cad into 3b84089ed749a7da100e5f757b3cd2dc/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/20ff06ee0c9f401ab2b5147041d9206a_SeqId_47_) 2023-02-11 19:54:38,643 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/d7e94b52b6c54bd88995c1adfdf9891a_SeqId_44_ to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/d7e94b52b6c54bd88995c1adfdf9891a_SeqId_44_ 2023-02-11 19:54:38,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyPolicy__j09pbia3gut4qt0uplcootq0tpolin3tjr0rkb9itggo1olouc5rp2r7p77rkbqu/family1/a62a65dfbf5043f39ff3c9375d9b5cad 2023-02-11 19:54:38,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-11 19:54:38,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-11 19:54:38,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(1912): 3b84089ed749a7da100e5f757b3cd2dc/family1 is initiating minor compaction (all files) 2023-02-11 19:54:38,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3b54efad; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:54:38,644 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 3b84089ed749a7da100e5f757b3cd2dc/family1 in testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:54:38,644 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/b56737bfe2924a07ad88c9274360cd57, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/4603d6241e9a4228923ce7e53399855e, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/20ff06ee0c9f401ab2b5147041d9206a_SeqId_47_] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp, totalSize=337.0 K 2023-02-11 19:54:38,644 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting b56737bfe2924a07ad88c9274360cd57, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878840136 2023-02-11 19:54:38,645 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 4603d6241e9a4228923ce7e53399855e, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621240136 2023-02-11 19:54:38,645 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 20ff06ee0c9f401ab2b5147041d9206a_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878840136 2023-02-11 19:54:38,646 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 19:54:38,646 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:54:38,648 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113027d3eda5596244f8840f8e003938b839 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113027d3eda5596244f8840f8e003938b839 2023-02-11 19:54:38,649 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201a9c8367798164fce95f5fd8fa8286420 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201a9c8367798164fce95f5fd8fa8286420 2023-02-11 19:54:38,650 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205d3253792a74e4dc89001be0fbf71d396 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205d3253792a74e4dc89001be0fbf71d396 2023-02-11 19:54:38,650 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-02-11 19:54:38,650 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-11 19:54:38,651 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 19:54:38,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 19:54:38,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:54:38,652 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 19:54:38,654 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8550 sec 2023-02-11 19:54:38,663 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3b84089ed749a7da100e5f757b3cd2dc#family1#compaction#50 average throughput is 19.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-02-11 19:54:38,687 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/.tmp/family1/c2917b68ce9e462c8f2419ea9dd5b1f0 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/c2917b68ce9e462c8f2419ea9dd5b1f0 2023-02-11 19:54:38,693 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 3b84089ed749a7da100e5f757b3cd2dc/family1 of 3b84089ed749a7da100e5f757b3cd2dc into c2917b68ce9e462c8f2419ea9dd5b1f0(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 19:54:38,693 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 3b84089ed749a7da100e5f757b3cd2dc: 2023-02-11 19:54:38,693 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1676145278644; duration=0sec 2023-02-11 19:54:38,693 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:54:38,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/b56737bfe2924a07ad88c9274360cd57, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/4603d6241e9a4228923ce7e53399855e, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/20ff06ee0c9f401ab2b5147041d9206a_SeqId_47_] to archive 2023-02-11 19:54:38,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:54:38,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/b56737bfe2924a07ad88c9274360cd57 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/b56737bfe2924a07ad88c9274360cd57 2023-02-11 19:54:38,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/4603d6241e9a4228923ce7e53399855e to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/4603d6241e9a4228923ce7e53399855e 2023-02-11 19:54:38,726 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/20ff06ee0c9f401ab2b5147041d9206a_SeqId_47_ to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/family1/20ff06ee0c9f401ab2b5147041d9206a_SeqId_47_ 2023-02-11 19:54:38,736 INFO [Listener at localhost/32929] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=249 (was 253), OpenFileDescriptor=600 (was 600), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=293 (was 377), ProcessCount=168 (was 168), AvailableMemoryMB=3627 (was 3705) 2023-02-11 19:54:38,746 INFO [Listener at localhost/32929] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=246, OpenFileDescriptor=600, MaxFileDescriptor=60000, SystemLoadAverage=293, ProcessCount=168, AvailableMemoryMB=3626 2023-02-11 19:54:38,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-11 19:54:38,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:38,750 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:54:38,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-02-11 19:54:38,751 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:54:38,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-11 19:54:38,753 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:38,753 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0 empty. 2023-02-11 19:54:38,753 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:38,753 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-02-11 19:54:38,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-11 19:54:39,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-11 19:54:39,161 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-11 19:54:39,163 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7671): creating {ENCODED => c5d7f471612198bab87fbe1b067a8ab0, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp 2023-02-11 19:54:39,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-11 19:54:39,568 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:54:39,569 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1603): Closing c5d7f471612198bab87fbe1b067a8ab0, disabling compactions & flushes 2023-02-11 19:54:39,569 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:39,569 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:39,569 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. after waiting 0 ms 2023-02-11 19:54:39,569 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:39,569 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:39,569 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1557): Region close journal for c5d7f471612198bab87fbe1b067a8ab0: Waiting for close lock at 1676145279569Disabling compacts and flushes for region at 1676145279569Disabling writes for close at 1676145279569Writing region close event to WAL at 1676145279569Closed at 1676145279569 2023-02-11 19:54:39,571 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:54:39,572 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676145279572"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145279572"}]},"ts":"1676145279572"} 2023-02-11 19:54:39,573 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 19:54:39,574 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:54:39,574 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145279574"}]},"ts":"1676145279574"} 2023-02-11 19:54:39,575 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-02-11 19:54:39,578 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c5d7f471612198bab87fbe1b067a8ab0, ASSIGN}] 2023-02-11 19:54:39,580 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c5d7f471612198bab87fbe1b067a8ab0, ASSIGN 2023-02-11 19:54:39,580 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c5d7f471612198bab87fbe1b067a8ab0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=false 2023-02-11 19:54:39,731 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=c5d7f471612198bab87fbe1b067a8ab0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:39,732 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676145279731"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145279731"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145279731"}]},"ts":"1676145279731"} 2023-02-11 19:54:39,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure c5d7f471612198bab87fbe1b067a8ab0, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:54:39,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-11 19:54:39,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:39,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c5d7f471612198bab87fbe1b067a8ab0, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:54:39,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:39,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:54:39,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:39,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:39,890 INFO [StoreOpener-c5d7f471612198bab87fbe1b067a8ab0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:39,892 DEBUG [StoreOpener-c5d7f471612198bab87fbe1b067a8ab0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1 2023-02-11 19:54:39,892 DEBUG [StoreOpener-c5d7f471612198bab87fbe1b067a8ab0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1 2023-02-11 19:54:39,892 INFO [StoreOpener-c5d7f471612198bab87fbe1b067a8ab0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5d7f471612198bab87fbe1b067a8ab0 columnFamilyName family1 2023-02-11 19:54:39,893 INFO [StoreOpener-c5d7f471612198bab87fbe1b067a8ab0-1] regionserver.HStore(310): Store=c5d7f471612198bab87fbe1b067a8ab0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:54:39,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:39,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:39,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:39,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:54:39,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c5d7f471612198bab87fbe1b067a8ab0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72454815, jitterRate=0.07966087758541107}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:54:39,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c5d7f471612198bab87fbe1b067a8ab0: Running coprocessor pre-open hook at 1676145279889Writing region info on filesystem at 1676145279889Initializing all the Stores at 1676145279890 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676145279890Cleaning up temporary data from old regions at 1676145279895 (+5 ms)Cleaning up detritus from prior splits at 1676145279895Running coprocessor post-open hooks at 1676145279898 (+3 ms)Region opened successfully at 1676145279898 2023-02-11 19:54:39,899 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0., pid=41, masterSystemTime=1676145279885 2023-02-11 19:54:39,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:39,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:39,901 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=c5d7f471612198bab87fbe1b067a8ab0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:39,901 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676145279901"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145279901"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145279901"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145279901"}]},"ts":"1676145279901"} 2023-02-11 19:54:39,903 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-02-11 19:54:39,903 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure c5d7f471612198bab87fbe1b067a8ab0, server=jenkins-hbase4.apache.org,45897,1676145215747 in 169 msec 2023-02-11 19:54:39,905 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-02-11 19:54:39,905 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c5d7f471612198bab87fbe1b067a8ab0, ASSIGN in 325 msec 2023-02-11 19:54:39,905 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:54:39,905 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145279905"}]},"ts":"1676145279905"} 2023-02-11 19:54:39,906 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-02-11 19:54:39,914 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:54:39,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1660 sec 2023-02-11 19:54:40,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-11 19:54:40,857 INFO [Listener at localhost/32929] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-02-11 19:54:40,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:40,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:40,878 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 19:54:40,878 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:40,878 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 19:54:40,878 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 19:54:40,879 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:40,879 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:40,880 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:40,880 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:40,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:40,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:40,880 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:40,880 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:40,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:40,881 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:40,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:40,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:40,881 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:40,881 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:40,881 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 19:54:40,881 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:40,882 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 19:54:40,882 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:40,882 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:40,882 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:40,882 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. started... 2023-02-11 19:54:40,883 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c5d7f471612198bab87fbe1b067a8ab0 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-11 19:54:41,299 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511309e7b60ed81e64368a313813208310efb to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511309e7b60ed81e64368a313813208310efb 2023-02-11 19:54:41,703 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp/family1/5d77ed15765d40dbbad2eac94d6c70e4 2023-02-11 19:54:41,709 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp/family1/5d77ed15765d40dbbad2eac94d6c70e4 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/5d77ed15765d40dbbad2eac94d6c70e4 2023-02-11 19:54:41,714 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/5d77ed15765d40dbbad2eac94d6c70e4, entries=1000, sequenceid=5, filesize=191.4 K 2023-02-11 19:54:41,715 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for c5d7f471612198bab87fbe1b067a8ab0 in 833ms, sequenceid=5, compaction requested=false 2023-02-11 19:54:41,715 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 19:54:41,715 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c5d7f471612198bab87fbe1b067a8ab0: 2023-02-11 19:54:41,715 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:41,715 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:41,715 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:41,715 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:41,715 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 19:54:41,716 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 19:54:41,717 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,717 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:41,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:41,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:41,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:41,717 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,717 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:41,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:41,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:41,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:41,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:41,719 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 19:54:41,719 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2da4e878[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:41,719 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 19:54:41,719 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,720 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,721 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 19:54:41,721 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 19:54:41,721 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:41,721 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:41,721 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:41,722 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:41,722 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 19:54:41,722 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:41,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:41,722 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 19:54:41,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:41,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:41,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:41,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:41,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:41,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:41,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:41,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:41,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 19:54:41,724 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 19:54:41,724 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:41,724 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:41,724 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,724 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:41,726 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,726 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:41,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:41,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,726 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:41,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:41,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:41,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:41,726 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:41,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:41,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:41,728 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:41,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:41,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:41,730 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:41,730 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:41,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:41,730 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-11 19:54:41,730 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:41,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:41,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 19:54:41,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:41,730 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:41,730 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,730 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,730 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:41,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:41,730 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:41,731 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:41,731 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:41,731 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,731 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,831 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:41,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:41,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:41,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:41,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,837 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 19:54:41,837 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:41,837 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 19:54:41,837 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 19:54:41,837 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,837 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,842 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:41,842 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:41,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:41,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:41,842 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:41,842 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:41,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:41,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,843 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,843 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 19:54:41,843 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:41,843 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 19:54:41,843 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:41,843 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 19:54:41,843 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:41,843 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:41,843 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:41,843 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. started... 2023-02-11 19:54:41,843 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c5d7f471612198bab87fbe1b067a8ab0 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-11 19:54:42,255 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d40cc1fe7176426c85ab3a7180956645 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128d40cc1fe7176426c85ab3a7180956645 2023-02-11 19:54:42,661 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp/family1/c2bb8893b128420fb7e5c09a2b0d4778 2023-02-11 19:54:42,665 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp/family1/c2bb8893b128420fb7e5c09a2b0d4778 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/c2bb8893b128420fb7e5c09a2b0d4778 2023-02-11 19:54:42,669 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/c2bb8893b128420fb7e5c09a2b0d4778, entries=1, sequenceid=9, filesize=5.0 K 2023-02-11 19:54:42,670 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for c5d7f471612198bab87fbe1b067a8ab0 in 827ms, sequenceid=9, compaction requested=false 2023-02-11 19:54:42,670 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c5d7f471612198bab87fbe1b067a8ab0: 2023-02-11 19:54:42,670 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:42,670 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:42,670 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:42,670 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:42,670 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 19:54:42,670 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 19:54:42,672 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,672 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:42,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:42,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:42,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:42,672 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,672 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:42,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:42,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:42,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:42,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:42,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 19:54:42,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bc58d84[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:42,674 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 19:54:42,674 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,675 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,675 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 19:54:42,675 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 19:54:42,675 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:42,675 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:42,675 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:42,677 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 19:54:42,678 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:42,678 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:42,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:42,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:42,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:42,678 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 19:54:42,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:42,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:42,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:42,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:42,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:42,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:42,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 19:54:42,680 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 19:54:42,680 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:42,680 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:42,680 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,680 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:42,681 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,681 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:42,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:42,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,681 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:42,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:42,682 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:42,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:42,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:42,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:42,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:42,683 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:42,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:42,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:42,690 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:42,690 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:42,690 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:42,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-11 19:54:42,690 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:42,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:42,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 19:54:42,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:42,690 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:42,690 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,690 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:42,690 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,690 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:42,690 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:42,690 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,690 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:42,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:42,791 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:42,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:42,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:42,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:42,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,797 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 19:54:42,797 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:42,797 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 19:54:42,797 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 19:54:42,797 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,797 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,800 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:42,800 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:42,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:42,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:42,800 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:42,800 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:42,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:42,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,801 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,801 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 19:54:42,801 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:42,801 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 19:54:42,801 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:42,802 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 19:54:42,802 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:42,802 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:42,802 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:42,802 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. started... 2023-02-11 19:54:42,802 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c5d7f471612198bab87fbe1b067a8ab0 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:43,214 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201e10f633b090b41ffa24cdabc140787b0 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201e10f633b090b41ffa24cdabc140787b0 2023-02-11 19:54:43,620 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp/family1/dc5966c24d404d17ae0e7ec151abb1d3 2023-02-11 19:54:43,625 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp/family1/dc5966c24d404d17ae0e7ec151abb1d3 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/dc5966c24d404d17ae0e7ec151abb1d3 2023-02-11 19:54:43,629 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/dc5966c24d404d17ae0e7ec151abb1d3, entries=1, sequenceid=13, filesize=5.0 K 2023-02-11 19:54:43,630 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c5d7f471612198bab87fbe1b067a8ab0 in 828ms, sequenceid=13, compaction requested=true 2023-02-11 19:54:43,630 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c5d7f471612198bab87fbe1b067a8ab0: 2023-02-11 19:54:43,630 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:43,630 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:43,630 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:43,630 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:43,630 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 19:54:43,630 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 19:54:43,632 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:43,632 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:43,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:43,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:43,632 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,632 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:43,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:43,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:43,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:43,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:43,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 19:54:43,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5add5aef[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:43,634 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 19:54:43,634 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,635 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,636 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 19:54:43,636 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 19:54:43,636 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:43,636 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:43,636 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:43,637 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:43,637 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 19:54:43,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:43,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:43,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:43,637 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:43,637 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 19:54:43,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:43,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:43,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:43,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:43,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:43,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:43,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 19:54:43,640 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 19:54:43,640 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:43,640 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:43,640 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,640 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:43,642 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,642 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,642 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:43,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:43,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:43,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:43,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:43,643 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:43,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:43,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:43,644 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:43,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:43,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:43,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,646 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:43,646 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:43,646 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,646 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:43,646 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:43,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:43,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:43,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 19:54:43,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:43,646 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,647 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:43,647 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-11 19:54:43,647 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:43,647 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:43,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:43,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:43,647 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,647 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,747 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:43,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:43,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:43,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:43,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,753 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 19:54:43,753 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:43,753 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 19:54:43,753 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 19:54:43,753 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,753 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,755 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:43,755 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:43,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:43,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:43,755 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:43,755 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:43,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,755 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:43,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,756 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,756 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 19:54:43,756 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:43,756 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 19:54:43,756 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:43,756 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 19:54:43,756 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:43,756 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:43,756 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:43,756 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. started... 2023-02-11 19:54:43,756 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c5d7f471612198bab87fbe1b067a8ab0 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:44,168 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055795c96a87384fd4afecf03e6f686f2e to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512055795c96a87384fd4afecf03e6f686f2e 2023-02-11 19:54:44,573 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp/family1/c17186daa3e54d0e89d5d22b49c813b0 2023-02-11 19:54:44,578 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp/family1/c17186daa3e54d0e89d5d22b49c813b0 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/c17186daa3e54d0e89d5d22b49c813b0 2023-02-11 19:54:44,582 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/c17186daa3e54d0e89d5d22b49c813b0, entries=1, sequenceid=17, filesize=5.0 K 2023-02-11 19:54:44,583 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c5d7f471612198bab87fbe1b067a8ab0 in 827ms, sequenceid=17, compaction requested=true 2023-02-11 19:54:44,583 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c5d7f471612198bab87fbe1b067a8ab0: 2023-02-11 19:54:44,583 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:44,583 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:44,583 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:44,583 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:44,583 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 19:54:44,583 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 19:54:44,585 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,585 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:44,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:44,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:44,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:44,585 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,585 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:44,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:44,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:44,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:44,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:44,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 19:54:44,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69ad2b3e[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:44,587 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 19:54:44,587 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,588 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,589 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 19:54:44,589 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 19:54:44,589 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:44,589 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:44,589 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:44,590 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 19:54:44,590 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:44,590 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:44,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:44,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:44,590 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 19:54:44,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:44,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:44,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:44,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:44,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:44,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:44,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:44,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 19:54:44,593 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 19:54:44,593 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:44,593 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:44,593 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,593 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:44,594 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,594 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:44,594 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:44,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:44,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:44,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:44,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:44,595 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:44,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,596 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:44,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:44,598 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:44,598 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,598 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,598 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:44,598 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:44,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:44,598 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-11 19:54:44,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 19:54:44,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:44,598 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,598 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:44,598 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:44,599 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:44,599 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:44,599 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,599 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:44,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:44,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:44,699 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:44,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:44,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:44,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:44,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,705 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 19:54:44,705 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:44,705 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 19:54:44,705 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 19:54:44,706 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,706 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,708 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:44,708 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:44,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:44,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:44,709 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:44,709 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:44,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,709 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:44,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,709 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,709 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 19:54:44,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:44,709 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 19:54:44,709 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:44,710 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 19:54:44,710 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:44,710 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:44,710 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:44,710 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. started... 2023-02-11 19:54:44,710 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c5d7f471612198bab87fbe1b067a8ab0 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:45,121 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512281a62a68f54f943b1858406d82b3d99e2 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512281a62a68f54f943b1858406d82b3d99e2 2023-02-11 19:54:45,417 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 19:54:45,526 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp/family1/6f045bc56521465f9075a027f765ed0b 2023-02-11 19:54:45,531 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp/family1/6f045bc56521465f9075a027f765ed0b as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/6f045bc56521465f9075a027f765ed0b 2023-02-11 19:54:45,534 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/6f045bc56521465f9075a027f765ed0b, entries=1, sequenceid=21, filesize=5.0 K 2023-02-11 19:54:45,535 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c5d7f471612198bab87fbe1b067a8ab0 in 825ms, sequenceid=21, compaction requested=true 2023-02-11 19:54:45,535 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c5d7f471612198bab87fbe1b067a8ab0: 2023-02-11 19:54:45,535 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:45,535 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:45,535 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:45,535 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:45,535 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 19:54:45,535 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 19:54:45,544 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:45,544 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:45,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:45,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:45,544 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,544 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:45,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:45,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:45,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:45,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:45,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 19:54:45,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63c0f95b[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:45,545 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 19:54:45,545 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,546 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,547 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 19:54:45,547 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 19:54:45,547 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:45,547 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:45,547 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:45,549 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:45,549 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 19:54:45,549 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:45,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:45,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:45,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:45,549 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 19:54:45,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:45,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:45,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:45,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:45,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:45,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:45,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 19:54:45,551 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 19:54:45,551 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:45,551 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:45,551 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,551 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:45,553 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,553 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,553 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:45,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:45,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:45,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:45,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:45,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:45,553 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:45,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:45,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:45,554 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:45,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:45,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:45,557 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:45,557 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,557 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,557 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:45,557 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:45,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:45,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 19:54:45,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:45,557 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:45,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:45,557 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:45,557 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,557 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:45,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:45,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:45,557 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,557 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:45,557 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,657 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:45,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:45,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:45,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:45,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,664 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 19:54:45,664 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:45,664 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 19:54:45,664 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 19:54:45,664 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,664 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,665 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:45,665 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:45,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:45,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:45,666 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:45,666 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:45,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:45,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,666 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,666 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 19:54:45,667 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:45,667 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 19:54:45,667 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:45,667 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 19:54:45,667 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:45,667 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:45,667 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:45,667 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. started... 2023-02-11 19:54:45,667 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c5d7f471612198bab87fbe1b067a8ab0 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:46,079 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512317ee851d9a97a49e09d28eca999a98033 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512317ee851d9a97a49e09d28eca999a98033 2023-02-11 19:54:46,484 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp/family1/9a8898959931446eb96c22b4f3d5b510 2023-02-11 19:54:46,489 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp/family1/9a8898959931446eb96c22b4f3d5b510 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/9a8898959931446eb96c22b4f3d5b510 2023-02-11 19:54:46,493 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/9a8898959931446eb96c22b4f3d5b510, entries=1, sequenceid=25, filesize=5.0 K 2023-02-11 19:54:46,494 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c5d7f471612198bab87fbe1b067a8ab0 in 827ms, sequenceid=25, compaction requested=true 2023-02-11 19:54:46,494 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c5d7f471612198bab87fbe1b067a8ab0: 2023-02-11 19:54:46,494 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:46,494 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:46,494 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:46,494 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:46,494 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 19:54:46,494 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 19:54:46,495 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:46,495 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:46,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:46,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:46,496 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,496 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:46,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:46,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:46,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:46,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:46,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 19:54:46,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@149ef10a[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:46,497 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 19:54:46,497 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,498 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,498 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 19:54:46,498 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 19:54:46,498 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:46,498 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:46,498 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:46,505 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 19:54:46,505 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:46,505 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:46,505 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 19:54:46,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:46,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:46,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:46,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:46,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:46,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:46,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:46,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:46,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:46,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 19:54:46,507 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 19:54:46,507 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:46,507 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:46,507 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,507 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:46,509 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,509 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:46,509 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:46,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:46,509 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:46,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,510 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:46,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:46,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:46,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:46,512 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:46,512 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:46,512 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:46,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 19:54:46,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:46,512 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:46,512 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,512 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:46,512 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:46,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:46,512 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,513 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:46,513 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:46,513 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:46,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:46,513 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,613 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:46,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:46,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:46,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:46,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,619 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 19:54:46,619 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:46,619 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 19:54:46,619 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 19:54:46,619 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,619 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,620 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:46,620 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:46,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:46,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:46,621 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:46,621 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:46,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:46,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,622 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,622 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 19:54:46,622 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:46,622 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 19:54:46,622 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:46,622 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 19:54:46,622 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:46,622 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:46,622 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:46,622 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. started... 2023-02-11 19:54:46,622 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c5d7f471612198bab87fbe1b067a8ab0 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:47,035 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601017fdfab42293c45e99b524868224e49d0 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601017fdfab42293c45e99b524868224e49d0 2023-02-11 19:54:47,440 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp/family1/f23261e858054f65b211d188a53ab29c 2023-02-11 19:54:47,445 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp/family1/f23261e858054f65b211d188a53ab29c as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/f23261e858054f65b211d188a53ab29c 2023-02-11 19:54:47,448 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/f23261e858054f65b211d188a53ab29c, entries=1, sequenceid=29, filesize=5.0 K 2023-02-11 19:54:47,449 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c5d7f471612198bab87fbe1b067a8ab0 in 827ms, sequenceid=29, compaction requested=true 2023-02-11 19:54:47,449 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c5d7f471612198bab87fbe1b067a8ab0: 2023-02-11 19:54:47,449 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:47,449 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:47,449 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:47,449 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:47,449 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 19:54:47,450 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 19:54:47,452 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,452 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:47,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:47,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:47,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:47,453 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,453 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:47,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:47,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:47,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:47,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:47,454 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 19:54:47,454 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24a4cb54[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:47,454 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 19:54:47,454 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,455 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,456 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 19:54:47,456 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 19:54:47,456 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:47,456 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:47,456 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:47,457 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 19:54:47,457 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:47,457 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:47,457 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 19:54:47,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:47,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:47,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:47,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:47,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:47,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:47,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:47,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:47,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:47,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 19:54:47,459 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 19:54:47,459 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:47,459 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:47,459 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,459 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:47,465 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,465 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:47,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:47,465 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:47,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:47,465 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:47,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:47,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:47,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:47,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:47,467 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:47,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:47,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:47,469 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:47,469 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:47,469 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:47,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 19:54:47,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:47,469 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:47,469 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-11 19:54:47,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:47,469 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:47,469 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,469 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:47,469 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,469 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:47,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:47,469 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:47,470 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:47,470 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,570 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:47,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:47,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:47,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:47,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,576 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 19:54:47,576 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:47,576 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 19:54:47,576 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 19:54:47,577 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,577 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,578 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:47,578 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:47,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:47,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:47,578 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:47,578 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:47,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:47,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,579 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,579 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 19:54:47,579 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:47,579 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 19:54:47,579 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:47,579 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 19:54:47,580 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:47,580 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:47,580 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:47,580 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. started... 2023-02-11 19:54:47,580 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c5d7f471612198bab87fbe1b067a8ab0 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:47,992 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c519a7e387cf4b2ca0f12c357fe4b24a to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103c519a7e387cf4b2ca0f12c357fe4b24a 2023-02-11 19:54:48,397 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp/family1/8458103cc7e8461b9fcc20e620e0a91a 2023-02-11 19:54:48,402 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp/family1/8458103cc7e8461b9fcc20e620e0a91a as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/8458103cc7e8461b9fcc20e620e0a91a 2023-02-11 19:54:48,406 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/8458103cc7e8461b9fcc20e620e0a91a, entries=1, sequenceid=33, filesize=5.0 K 2023-02-11 19:54:48,406 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c5d7f471612198bab87fbe1b067a8ab0 in 826ms, sequenceid=33, compaction requested=true 2023-02-11 19:54:48,406 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c5d7f471612198bab87fbe1b067a8ab0: 2023-02-11 19:54:48,406 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:48,406 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:48,407 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:48,407 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:48,407 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 19:54:48,407 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 19:54:48,408 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:48,408 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:48,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:48,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:48,408 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,409 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:48,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:48,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:48,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:48,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:48,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 19:54:48,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24d0f025[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:48,410 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 19:54:48,410 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,412 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,412 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 19:54:48,412 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 19:54:48,412 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:48,412 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:48,412 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:48,414 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 19:54:48,414 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:48,414 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:48,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:48,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:48,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:48,414 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 19:54:48,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:48,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:48,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:48,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:48,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:48,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:48,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 19:54:48,416 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 19:54:48,416 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:48,416 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:48,416 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,416 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:48,417 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,417 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:48,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:48,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,417 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:48,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:48,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:48,418 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:48,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:48,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:48,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,419 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:48,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:48,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:48,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:48,421 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:48,421 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,421 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,421 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:48,421 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:48,421 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-11 19:54:48,421 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:48,421 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:48,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:48,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 19:54:48,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:48,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:48,421 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,421 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,421 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,421 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:48,422 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:48,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:48,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:48,522 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:48,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:48,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:48,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:48,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,528 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 19:54:48,528 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:48,528 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 19:54:48,528 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 19:54:48,528 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,528 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,530 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:48,530 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:48,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:48,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:48,530 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:48,530 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:48,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:48,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,531 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,531 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 19:54:48,531 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:48,531 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 19:54:48,531 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:48,531 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 19:54:48,531 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:48,531 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:48,532 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:48,532 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. started... 2023-02-11 19:54:48,532 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c5d7f471612198bab87fbe1b067a8ab0 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:48,943 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907f360e959d64d48618b2359aea466c7a1 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907f360e959d64d48618b2359aea466c7a1 2023-02-11 19:54:49,349 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp/family1/01c9979845d54fe999253445deaa1b29 2023-02-11 19:54:49,353 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp/family1/01c9979845d54fe999253445deaa1b29 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/01c9979845d54fe999253445deaa1b29 2023-02-11 19:54:49,356 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/01c9979845d54fe999253445deaa1b29, entries=1, sequenceid=37, filesize=5.0 K 2023-02-11 19:54:49,357 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c5d7f471612198bab87fbe1b067a8ab0 in 825ms, sequenceid=37, compaction requested=true 2023-02-11 19:54:49,357 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c5d7f471612198bab87fbe1b067a8ab0: 2023-02-11 19:54:49,357 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:49,357 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:49,357 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:49,357 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:49,357 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 19:54:49,358 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 19:54:49,360 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,360 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:49,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:49,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:49,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:49,360 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,360 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:49,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:49,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:49,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:49,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:49,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 19:54:49,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40bedfc5[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:49,362 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 19:54:49,362 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,364 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,364 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 19:54:49,364 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 19:54:49,364 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:49,364 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:49,364 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:49,366 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 19:54:49,366 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:49,366 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:49,366 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 19:54:49,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:49,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:49,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:49,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:49,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:49,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:49,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:49,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:49,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:49,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 19:54:49,368 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 19:54:49,368 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:49,368 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:49,368 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,368 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:49,371 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,371 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:49,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,371 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:49,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:49,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:49,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:49,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:49,372 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:49,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:49,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,373 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:49,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:49,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:49,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:49,380 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:49,381 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:49,381 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:49,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:49,381 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:49,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 19:54:49,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:49,381 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,381 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:49,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:49,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:49,381 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:49,381 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:49,381 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:49,381 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,381 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,381 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,481 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:49,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:49,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:49,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:49,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,488 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 19:54:49,488 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:49,488 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 19:54:49,488 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 19:54:49,488 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,488 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,489 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:49,489 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:49,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:49,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:49,490 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:49,490 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:49,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:49,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,491 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,492 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 19:54:49,492 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:49,492 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 19:54:49,492 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:49,492 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 19:54:49,492 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:49,492 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:49,492 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:49,492 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. started... 2023-02-11 19:54:49,492 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c5d7f471612198bab87fbe1b067a8ab0 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:49,906 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120b19123eea3614b699dd2bf6fc33962c8 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120b19123eea3614b699dd2bf6fc33962c8 2023-02-11 19:54:50,312 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp/family1/fd97d77aefba46528fc18b4e6f2bd990 2023-02-11 19:54:50,316 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp/family1/fd97d77aefba46528fc18b4e6f2bd990 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/fd97d77aefba46528fc18b4e6f2bd990 2023-02-11 19:54:50,320 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/fd97d77aefba46528fc18b4e6f2bd990, entries=1, sequenceid=41, filesize=5.0 K 2023-02-11 19:54:50,321 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c5d7f471612198bab87fbe1b067a8ab0 in 829ms, sequenceid=41, compaction requested=true 2023-02-11 19:54:50,321 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c5d7f471612198bab87fbe1b067a8ab0: 2023-02-11 19:54:50,321 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:50,321 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:50,321 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:50,321 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:50,321 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 19:54:50,321 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 19:54:50,323 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:50,323 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:50,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:50,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:50,323 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,324 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:50,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:50,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:50,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:50,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:50,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 19:54:50,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23cb6079[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:50,325 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 19:54:50,325 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,327 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,327 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 19:54:50,327 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:50,327 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:50,327 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 19:54:50,327 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:50,329 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 19:54:50,329 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:50,329 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:50,329 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 19:54:50,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:50,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:50,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:50,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:50,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:50,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:50,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:50,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:50,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:50,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 19:54:50,331 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 19:54:50,331 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:50,331 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:50,331 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,331 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:50,333 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,333 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,333 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:50,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:50,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:50,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:50,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:50,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:50,333 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:50,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:50,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,334 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:50,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:50,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:50,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:50,336 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:50,336 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,336 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,336 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:50,336 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:50,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:50,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 19:54:50,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:50,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:50,336 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:50,336 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,336 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,337 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,336 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:50,337 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:50,337 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:50,337 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-11 19:54:50,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:50,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:50,437 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:50,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:50,439 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40445] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:50,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 19:54:50,441 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 19:54:50,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:54:50,442 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676145890442 2023-02-11 19:54:50,444 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 19:54:50,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-11 19:54:50,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 19:54:50,445 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] zookeeper.ReadOnlyZKClient(139): Connect 0x1a35b423 to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:54:50,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6708a32d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:54:50,452 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:51,286 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032f97bb40f84b43019e62108e8b1d349e to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601032f97bb40f84b43019e62108e8b1d349e 2023-02-11 19:54:51,287 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 19:54:51,299 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:54:51,300 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46566, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:54:51,306 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:54:51,308 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53172, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:54:51,319 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/139dcccdeb324b3791de7f08f227fc12 first=Optional[r3] last=Optional[r6] 2023-02-11 19:54:51,319 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/139dcccdeb324b3791de7f08f227fc12}] 2023-02-11 19:54:51,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/139dcccdeb324b3791de7f08f227fc12 for inclusion in c5d7f471612198bab87fbe1b067a8ab0/family1 2023-02-11 19:54:51,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-11 19:54:51,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 19:54:51,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for c5d7f471612198bab87fbe1b067a8ab0: 2023-02-11 19:54:51,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/139dcccdeb324b3791de7f08f227fc12 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mv824q20oufc8t9h75181br862grvtq420fc0ls9m1ivn51t6vi0fed5jl4uvnb2/family1/139dcccdeb324b3791de7f08f227fc12 2023-02-11 19:54:51,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mv824q20oufc8t9h75181br862grvtq420fc0ls9m1ivn51t6vi0fed5jl4uvnb2/family1/139dcccdeb324b3791de7f08f227fc12 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/30b94f0859ff400ca33784e2050e9205_SeqId_44_ 2023-02-11 19:54:51,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mv824q20oufc8t9h75181br862grvtq420fc0ls9m1ivn51t6vi0fed5jl4uvnb2/family1/139dcccdeb324b3791de7f08f227fc12 into c5d7f471612198bab87fbe1b067a8ab0/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/30b94f0859ff400ca33784e2050e9205_SeqId_44_ - updating store file list. 2023-02-11 19:54:51,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/30b94f0859ff400ca33784e2050e9205_SeqId_44_ into c5d7f471612198bab87fbe1b067a8ab0/family1 2023-02-11 19:54:51,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mv824q20oufc8t9h75181br862grvtq420fc0ls9m1ivn51t6vi0fed5jl4uvnb2/family1/139dcccdeb324b3791de7f08f227fc12 into c5d7f471612198bab87fbe1b067a8ab0/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/30b94f0859ff400ca33784e2050e9205_SeqId_44_) 2023-02-11 19:54:51,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mv824q20oufc8t9h75181br862grvtq420fc0ls9m1ivn51t6vi0fed5jl4uvnb2/family1/139dcccdeb324b3791de7f08f227fc12 2023-02-11 19:54:51,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-11 19:54:51,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-11 19:54:51,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(1912): c5d7f471612198bab87fbe1b067a8ab0/family1 is initiating minor compaction 2023-02-11 19:54:51,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6a67993c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:54:51,338 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of c5d7f471612198bab87fbe1b067a8ab0/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:51,338 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/c2bb8893b128420fb7e5c09a2b0d4778, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/dc5966c24d404d17ae0e7ec151abb1d3, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/c17186daa3e54d0e89d5d22b49c813b0, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/6f045bc56521465f9075a027f765ed0b, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/9a8898959931446eb96c22b4f3d5b510, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/f23261e858054f65b211d188a53ab29c, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/8458103cc7e8461b9fcc20e620e0a91a, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/01c9979845d54fe999253445deaa1b29, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/fd97d77aefba46528fc18b4e6f2bd990, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/30b94f0859ff400ca33784e2050e9205_SeqId_44_] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp, totalSize=50.4 K 2023-02-11 19:54:51,338 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting c2bb8893b128420fb7e5c09a2b0d4778, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 19:54:51,338 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting dc5966c24d404d17ae0e7ec151abb1d3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 19:54:51,338 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting c17186daa3e54d0e89d5d22b49c813b0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-11 19:54:51,338 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 6f045bc56521465f9075a027f765ed0b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-11 19:54:51,338 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 9a8898959931446eb96c22b4f3d5b510, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-11 19:54:51,338 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting f23261e858054f65b211d188a53ab29c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-11 19:54:51,338 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 8458103cc7e8461b9fcc20e620e0a91a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-11 19:54:51,338 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 01c9979845d54fe999253445deaa1b29, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-11 19:54:51,338 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting fd97d77aefba46528fc18b4e6f2bd990, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-11 19:54:51,338 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 30b94f0859ff400ca33784e2050e9205_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-11 19:54:51,340 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 19:54:51,341 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:54:51,342 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512281a62a68f54f943b1858406d82b3d99e2 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512281a62a68f54f943b1858406d82b3d99e2 2023-02-11 19:54:51,344 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512317ee851d9a97a49e09d28eca999a98033 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512317ee851d9a97a49e09d28eca999a98033 2023-02-11 19:54:51,345 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601017fdfab42293c45e99b524868224e49d0 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601017fdfab42293c45e99b524868224e49d0 2023-02-11 19:54:51,346 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103c519a7e387cf4b2ca0f12c357fe4b24a to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103c519a7e387cf4b2ca0f12c357fe4b24a 2023-02-11 19:54:51,346 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-02-11 19:54:51,346 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-11 19:54:51,346 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:51,346 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:51,346 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:51,346 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:51,346 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:51,346 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:51,346 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:51,347 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:51,366 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] throttle.PressureAwareThroughputController(145): c5d7f471612198bab87fbe1b067a8ab0#family1#compaction#61 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-02-11 19:54:51,788 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp/family1/42b3cab8737b4d6799fb06f64020216f as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/42b3cab8737b4d6799fb06f64020216f 2023-02-11 19:54:51,791 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055b199ff7ac2b45269090d44e332b8769 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512055b199ff7ac2b45269090d44e332b8769 2023-02-11 19:54:51,792 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 19:54:51,793 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in c5d7f471612198bab87fbe1b067a8ab0/family1 of c5d7f471612198bab87fbe1b067a8ab0 into 42b3cab8737b4d6799fb06f64020216f(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 19:54:51,793 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for c5d7f471612198bab87fbe1b067a8ab0: 2023-02-11 19:54:51,793 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1676145291338; duration=0sec 2023-02-11 19:54:51,793 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:54:51,817 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f091d40e9ad94e0b866512896dc15c8a first=Optional[r00] last=Optional[r2] 2023-02-11 19:54:51,818 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f091d40e9ad94e0b866512896dc15c8a}] 2023-02-11 19:54:51,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f091d40e9ad94e0b866512896dc15c8a for inclusion in c5d7f471612198bab87fbe1b067a8ab0/family1 2023-02-11 19:54:51,827 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/c2bb8893b128420fb7e5c09a2b0d4778, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/dc5966c24d404d17ae0e7ec151abb1d3, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/c17186daa3e54d0e89d5d22b49c813b0, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/6f045bc56521465f9075a027f765ed0b, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/9a8898959931446eb96c22b4f3d5b510, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/f23261e858054f65b211d188a53ab29c, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/8458103cc7e8461b9fcc20e620e0a91a, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/01c9979845d54fe999253445deaa1b29, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/fd97d77aefba46528fc18b4e6f2bd990, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/30b94f0859ff400ca33784e2050e9205_SeqId_44_] to archive 2023-02-11 19:54:51,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:54:51,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-11 19:54:51,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 19:54:51,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for c5d7f471612198bab87fbe1b067a8ab0: 2023-02-11 19:54:51,830 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/c2bb8893b128420fb7e5c09a2b0d4778 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/c2bb8893b128420fb7e5c09a2b0d4778 2023-02-11 19:54:51,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f091d40e9ad94e0b866512896dc15c8a to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__43bbv1g6grn7uqf1460nvgin8auf4pkas1f3juj8vdn08jep9819qab27ap9u0ei/family1/f091d40e9ad94e0b866512896dc15c8a 2023-02-11 19:54:51,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/dc5966c24d404d17ae0e7ec151abb1d3 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/dc5966c24d404d17ae0e7ec151abb1d3 2023-02-11 19:54:51,832 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/c17186daa3e54d0e89d5d22b49c813b0 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/c17186daa3e54d0e89d5d22b49c813b0 2023-02-11 19:54:51,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__43bbv1g6grn7uqf1460nvgin8auf4pkas1f3juj8vdn08jep9819qab27ap9u0ei/family1/f091d40e9ad94e0b866512896dc15c8a as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/a65e5cd68e9f48af89ea8109ffa584f1_SeqId_47_ 2023-02-11 19:54:51,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__43bbv1g6grn7uqf1460nvgin8auf4pkas1f3juj8vdn08jep9819qab27ap9u0ei/family1/f091d40e9ad94e0b866512896dc15c8a into c5d7f471612198bab87fbe1b067a8ab0/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/a65e5cd68e9f48af89ea8109ffa584f1_SeqId_47_ - updating store file list. 2023-02-11 19:54:51,834 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/6f045bc56521465f9075a027f765ed0b to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/6f045bc56521465f9075a027f765ed0b 2023-02-11 19:54:51,835 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/9a8898959931446eb96c22b4f3d5b510 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/9a8898959931446eb96c22b4f3d5b510 2023-02-11 19:54:51,836 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/f23261e858054f65b211d188a53ab29c to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/f23261e858054f65b211d188a53ab29c 2023-02-11 19:54:51,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/a65e5cd68e9f48af89ea8109ffa584f1_SeqId_47_ into c5d7f471612198bab87fbe1b067a8ab0/family1 2023-02-11 19:54:51,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__43bbv1g6grn7uqf1460nvgin8auf4pkas1f3juj8vdn08jep9819qab27ap9u0ei/family1/f091d40e9ad94e0b866512896dc15c8a into c5d7f471612198bab87fbe1b067a8ab0/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/a65e5cd68e9f48af89ea8109ffa584f1_SeqId_47_) 2023-02-11 19:54:51,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__43bbv1g6grn7uqf1460nvgin8auf4pkas1f3juj8vdn08jep9819qab27ap9u0ei/family1/f091d40e9ad94e0b866512896dc15c8a 2023-02-11 19:54:51,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-11 19:54:51,838 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/8458103cc7e8461b9fcc20e620e0a91a to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/8458103cc7e8461b9fcc20e620e0a91a 2023-02-11 19:54:51,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-11 19:54:51,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(1912): c5d7f471612198bab87fbe1b067a8ab0/family1 is initiating minor compaction (all files) 2023-02-11 19:54:51,839 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/01c9979845d54fe999253445deaa1b29 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/01c9979845d54fe999253445deaa1b29 2023-02-11 19:54:51,839 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of c5d7f471612198bab87fbe1b067a8ab0/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:51,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4c79b6b3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:54:51,839 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/5d77ed15765d40dbbad2eac94d6c70e4, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/42b3cab8737b4d6799fb06f64020216f, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/a65e5cd68e9f48af89ea8109ffa584f1_SeqId_47_] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp, totalSize=390.1 K 2023-02-11 19:54:51,840 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 5d77ed15765d40dbbad2eac94d6c70e4, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878840136 2023-02-11 19:54:51,840 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 42b3cab8737b4d6799fb06f64020216f, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621240136 2023-02-11 19:54:51,841 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/fd97d77aefba46528fc18b4e6f2bd990 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/fd97d77aefba46528fc18b4e6f2bd990 2023-02-11 19:54:51,841 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting a65e5cd68e9f48af89ea8109ffa584f1_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878840136 2023-02-11 19:54:51,842 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 19:54:51,842 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/30b94f0859ff400ca33784e2050e9205_SeqId_44_ to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/30b94f0859ff400ca33784e2050e9205_SeqId_44_ 2023-02-11 19:54:51,844 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:54:51,845 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511309e7b60ed81e64368a313813208310efb to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511309e7b60ed81e64368a313813208310efb 2023-02-11 19:54:51,847 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201e10f633b090b41ffa24cdabc140787b0 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201e10f633b090b41ffa24cdabc140787b0 2023-02-11 19:54:51,848 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512055795c96a87384fd4afecf03e6f686f2e to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512055795c96a87384fd4afecf03e6f686f2e 2023-02-11 19:54:51,849 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-02-11 19:54:51,849 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-11 19:54:51,850 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:51,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 19:54:51,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:54:51,851 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 19:54:51,852 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.4110 sec 2023-02-11 19:54:51,859 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] throttle.PressureAwareThroughputController(145): c5d7f471612198bab87fbe1b067a8ab0#family1#compaction#62 average throughput is 30.10 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-02-11 19:54:51,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-11 19:54:51,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:52,331 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-11 19:54:52,332 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-11 19:54:52,332 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-11 19:54:52,334 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-11 19:54:52,336 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c5d7f471612198bab87fbe1b067a8ab0, REOPEN/MOVE}] 2023-02-11 19:54:52,337 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c5d7f471612198bab87fbe1b067a8ab0, REOPEN/MOVE 2023-02-11 19:54:52,337 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=c5d7f471612198bab87fbe1b067a8ab0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:52,337 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676145292337"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145292337"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145292337"}]},"ts":"1676145292337"} 2023-02-11 19:54:52,339 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure c5d7f471612198bab87fbe1b067a8ab0, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:54:52,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:52,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c5d7f471612198bab87fbe1b067a8ab0, disabling compactions & flushes 2023-02-11 19:54:52,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:53,080 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/.tmp/family1/8e06c76ac489443186c7ed2ffd70bbbf as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/8e06c76ac489443186c7ed2ffd70bbbf 2023-02-11 19:54:53,084 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in c5d7f471612198bab87fbe1b067a8ab0/family1 of c5d7f471612198bab87fbe1b067a8ab0 into 8e06c76ac489443186c7ed2ffd70bbbf(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 19:54:53,084 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for c5d7f471612198bab87fbe1b067a8ab0: 2023-02-11 19:54:53,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:53,084 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1676145291839; duration=1sec 2023-02-11 19:54:53,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:53,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. after waiting 0 ms 2023-02-11 19:54:53,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:53,084 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:54:53,085 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/5d77ed15765d40dbbad2eac94d6c70e4, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/42b3cab8737b4d6799fb06f64020216f, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/a65e5cd68e9f48af89ea8109ffa584f1_SeqId_47_] to archive 2023-02-11 19:54:53,086 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:54:53,087 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/5d77ed15765d40dbbad2eac94d6c70e4 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/5d77ed15765d40dbbad2eac94d6c70e4 2023-02-11 19:54:53,088 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/42b3cab8737b4d6799fb06f64020216f to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/42b3cab8737b4d6799fb06f64020216f 2023-02-11 19:54:53,089 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/a65e5cd68e9f48af89ea8109ffa584f1_SeqId_47_ to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/a65e5cd68e9f48af89ea8109ffa584f1_SeqId_47_ 2023-02-11 19:54:53,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-11 19:54:53,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:53,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c5d7f471612198bab87fbe1b067a8ab0: Waiting for close lock at 1676145292489Running coprocessor pre-close hooks at 1676145292489Disabling compacts and flushes for region at 1676145292489Disabling writes for close at 1676145293084 (+595 ms)Writing region close event to WAL at 1676145293091 (+7 ms)Running coprocessor post-close hooks at 1676145293094 (+3 ms)Closed at 1676145293094 2023-02-11 19:54:53,094 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: c5d7f471612198bab87fbe1b067a8ab0 to self. 2023-02-11 19:54:53,096 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:53,096 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=c5d7f471612198bab87fbe1b067a8ab0, regionState=CLOSED 2023-02-11 19:54:53,096 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676145293096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145293096"}]},"ts":"1676145293096"} 2023-02-11 19:54:53,098 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-02-11 19:54:53,099 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure c5d7f471612198bab87fbe1b067a8ab0, server=jenkins-hbase4.apache.org,45897,1676145215747 in 758 msec 2023-02-11 19:54:53,099 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c5d7f471612198bab87fbe1b067a8ab0, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=true 2023-02-11 19:54:53,249 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=c5d7f471612198bab87fbe1b067a8ab0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:53,250 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676145293249"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145293249"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145293249"}]},"ts":"1676145293249"} 2023-02-11 19:54:53,251 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure c5d7f471612198bab87fbe1b067a8ab0, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:54:53,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:53,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c5d7f471612198bab87fbe1b067a8ab0, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:54:53,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:53,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:54:53,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:53,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:53,407 INFO [StoreOpener-c5d7f471612198bab87fbe1b067a8ab0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:53,407 DEBUG [StoreOpener-c5d7f471612198bab87fbe1b067a8ab0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1 2023-02-11 19:54:53,408 DEBUG [StoreOpener-c5d7f471612198bab87fbe1b067a8ab0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1 2023-02-11 19:54:53,408 INFO [StoreOpener-c5d7f471612198bab87fbe1b067a8ab0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5d7f471612198bab87fbe1b067a8ab0 columnFamilyName family1 2023-02-11 19:54:53,413 DEBUG [StoreOpener-c5d7f471612198bab87fbe1b067a8ab0-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/8e06c76ac489443186c7ed2ffd70bbbf 2023-02-11 19:54:53,413 INFO [StoreOpener-c5d7f471612198bab87fbe1b067a8ab0-1] regionserver.HStore(310): Store=c5d7f471612198bab87fbe1b067a8ab0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:54:53,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:53,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:53,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:53,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c5d7f471612198bab87fbe1b067a8ab0; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69889707, jitterRate=0.0414377897977829}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:54:53,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c5d7f471612198bab87fbe1b067a8ab0: Running coprocessor pre-open hook at 1676145293406Writing region info on filesystem at 1676145293406Initializing all the Stores at 1676145293406Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676145293406Cleaning up temporary data from old regions at 1676145293415 (+9 ms)Cleaning up detritus from prior splits at 1676145293415Running coprocessor post-open hooks at 1676145293418 (+3 ms)Region opened successfully at 1676145293418 2023-02-11 19:54:53,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0., pid=47, masterSystemTime=1676145293402 2023-02-11 19:54:53,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:53,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:53,420 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=c5d7f471612198bab87fbe1b067a8ab0, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:53,420 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676145293420"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145293420"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145293420"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145293420"}]},"ts":"1676145293420"} 2023-02-11 19:54:53,423 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-02-11 19:54:53,423 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure c5d7f471612198bab87fbe1b067a8ab0, server=jenkins-hbase4.apache.org,45897,1676145215747 in 171 msec 2023-02-11 19:54:53,424 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-02-11 19:54:53,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c5d7f471612198bab87fbe1b067a8ab0, REOPEN/MOVE in 1.0870 sec 2023-02-11 19:54:53,426 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-11 19:54:53,426 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0910 sec 2023-02-11 19:54:53,428 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5060 sec 2023-02-11 19:54:53,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-02-11 19:54:53,430 INFO [Listener at localhost/32929] compactions.TestMobCompactor(278): alter status finished 2023-02-11 19:54:53,431 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40445] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:53,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 19:54:53,432 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 19:54:53,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:54:53,433 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676145893433 2023-02-11 19:54:53,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 19:54:53,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-11 19:54:53,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 19:54:53,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] zookeeper.ReadOnlyZKClient(139): Connect 0x598c775b to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:54:53,439 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b3fb68c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:54:53,439 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:53,440 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:53,440 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:53,440 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:53,440 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:54,266 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e8b504a11150418f8d18b797b7733890 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128e8b504a11150418f8d18b797b7733890 2023-02-11 19:54:54,267 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 19:54:54,279 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:54:54,280 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48868, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:54:54,286 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:54:54,288 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58816, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:54:54,295 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/abdb0bd9d0ff4047bfb5858548dca0d6 first=Optional[r05] last=Optional[r8] 2023-02-11 19:54:54,295 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=51 for row with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/abdb0bd9d0ff4047bfb5858548dca0d6}] 2023-02-11 19:54:54,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/abdb0bd9d0ff4047bfb5858548dca0d6 for inclusion in c5d7f471612198bab87fbe1b067a8ab0/family1 2023-02-11 19:54:54,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-11 19:54:54,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 19:54:54,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for c5d7f471612198bab87fbe1b067a8ab0: 2023-02-11 19:54:54,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/abdb0bd9d0ff4047bfb5858548dca0d6 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__u5bq5g84q5htse381n17coajrvj0foltpg2a96u6juof71ubpbeds0g7bgsephju/family1/abdb0bd9d0ff4047bfb5858548dca0d6 2023-02-11 19:54:54,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__u5bq5g84q5htse381n17coajrvj0foltpg2a96u6juof71ubpbeds0g7bgsephju/family1/abdb0bd9d0ff4047bfb5858548dca0d6 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/0a39d0968d9a4f0489788c9643aa84be_SeqId_53_ 2023-02-11 19:54:54,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__u5bq5g84q5htse381n17coajrvj0foltpg2a96u6juof71ubpbeds0g7bgsephju/family1/abdb0bd9d0ff4047bfb5858548dca0d6 into c5d7f471612198bab87fbe1b067a8ab0/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/0a39d0968d9a4f0489788c9643aa84be_SeqId_53_ - updating store file list. 2023-02-11 19:54:54,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/0a39d0968d9a4f0489788c9643aa84be_SeqId_53_ into c5d7f471612198bab87fbe1b067a8ab0/family1 2023-02-11 19:54:54,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__u5bq5g84q5htse381n17coajrvj0foltpg2a96u6juof71ubpbeds0g7bgsephju/family1/abdb0bd9d0ff4047bfb5858548dca0d6 into c5d7f471612198bab87fbe1b067a8ab0/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/0a39d0968d9a4f0489788c9643aa84be_SeqId_53_) 2023-02-11 19:54:54,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__u5bq5g84q5htse381n17coajrvj0foltpg2a96u6juof71ubpbeds0g7bgsephju/family1/abdb0bd9d0ff4047bfb5858548dca0d6 2023-02-11 19:54:54,311 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 19:54:54,312 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:54:54,313 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120b19123eea3614b699dd2bf6fc33962c8 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120b19123eea3614b699dd2bf6fc33962c8 2023-02-11 19:54:54,314 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128d40cc1fe7176426c85ab3a7180956645 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128d40cc1fe7176426c85ab3a7180956645 2023-02-11 19:54:54,314 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-02-11 19:54:54,314 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-11 19:54:54,315 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:54,315 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:54,315 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:54,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 19:54:54,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:54:54,316 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 19:54:54,317 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 885 msec 2023-02-11 19:54:54,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-11 19:54:54,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:54,780 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-11 19:54:54,781 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-11 19:54:54,781 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-11 19:54:54,783 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-11 19:54:54,787 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c5d7f471612198bab87fbe1b067a8ab0, REOPEN/MOVE}] 2023-02-11 19:54:54,788 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c5d7f471612198bab87fbe1b067a8ab0, REOPEN/MOVE 2023-02-11 19:54:54,788 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=c5d7f471612198bab87fbe1b067a8ab0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:54,788 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676145294788"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145294788"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145294788"}]},"ts":"1676145294788"} 2023-02-11 19:54:54,790 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure c5d7f471612198bab87fbe1b067a8ab0, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:54:54,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:54,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c5d7f471612198bab87fbe1b067a8ab0, disabling compactions & flushes 2023-02-11 19:54:54,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:54,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:54,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. after waiting 0 ms 2023-02-11 19:54:54,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:54,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-11 19:54:54,948 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:54,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c5d7f471612198bab87fbe1b067a8ab0: Waiting for close lock at 1676145294942Running coprocessor pre-close hooks at 1676145294942Disabling compacts and flushes for region at 1676145294942Disabling writes for close at 1676145294942Writing region close event to WAL at 1676145294944 (+2 ms)Running coprocessor post-close hooks at 1676145294948 (+4 ms)Closed at 1676145294948 2023-02-11 19:54:54,948 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: c5d7f471612198bab87fbe1b067a8ab0 to self. 2023-02-11 19:54:54,949 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:54,950 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=c5d7f471612198bab87fbe1b067a8ab0, regionState=CLOSED 2023-02-11 19:54:54,950 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676145294950"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145294950"}]},"ts":"1676145294950"} 2023-02-11 19:54:54,952 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-02-11 19:54:54,952 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure c5d7f471612198bab87fbe1b067a8ab0, server=jenkins-hbase4.apache.org,45897,1676145215747 in 161 msec 2023-02-11 19:54:54,953 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c5d7f471612198bab87fbe1b067a8ab0, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=true 2023-02-11 19:54:55,103 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=c5d7f471612198bab87fbe1b067a8ab0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:55,103 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676145295103"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145295103"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145295103"}]},"ts":"1676145295103"} 2023-02-11 19:54:55,105 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure c5d7f471612198bab87fbe1b067a8ab0, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:54:55,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:55,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c5d7f471612198bab87fbe1b067a8ab0, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:54:55,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:55,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:54:55,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:55,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:55,260 INFO [StoreOpener-c5d7f471612198bab87fbe1b067a8ab0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:55,261 DEBUG [StoreOpener-c5d7f471612198bab87fbe1b067a8ab0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1 2023-02-11 19:54:55,261 DEBUG [StoreOpener-c5d7f471612198bab87fbe1b067a8ab0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1 2023-02-11 19:54:55,262 INFO [StoreOpener-c5d7f471612198bab87fbe1b067a8ab0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5d7f471612198bab87fbe1b067a8ab0 columnFamilyName family1 2023-02-11 19:54:55,266 DEBUG [StoreOpener-c5d7f471612198bab87fbe1b067a8ab0-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/0a39d0968d9a4f0489788c9643aa84be_SeqId_53_ 2023-02-11 19:54:55,269 DEBUG [StoreOpener-c5d7f471612198bab87fbe1b067a8ab0-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/family1/8e06c76ac489443186c7ed2ffd70bbbf 2023-02-11 19:54:55,269 INFO [StoreOpener-c5d7f471612198bab87fbe1b067a8ab0-1] regionserver.HStore(310): Store=c5d7f471612198bab87fbe1b067a8ab0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:54:55,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:55,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:55,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:54:55,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c5d7f471612198bab87fbe1b067a8ab0; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59815854, jitterRate=-0.1086743175983429}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:54:55,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c5d7f471612198bab87fbe1b067a8ab0: Running coprocessor pre-open hook at 1676145295259Writing region info on filesystem at 1676145295259Initializing all the Stores at 1676145295260 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676145295260Cleaning up temporary data from old regions at 1676145295271 (+11 ms)Cleaning up detritus from prior splits at 1676145295272 (+1 ms)Running coprocessor post-open hooks at 1676145295274 (+2 ms)Region opened successfully at 1676145295274 2023-02-11 19:54:55,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0., pid=53, masterSystemTime=1676145295256 2023-02-11 19:54:55,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:55,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:54:55,277 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=c5d7f471612198bab87fbe1b067a8ab0, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:55,277 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676145295277"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145295277"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145295277"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145295277"}]},"ts":"1676145295277"} 2023-02-11 19:54:55,280 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-02-11 19:54:55,280 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure c5d7f471612198bab87fbe1b067a8ab0, server=jenkins-hbase4.apache.org,45897,1676145215747 in 173 msec 2023-02-11 19:54:55,281 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-02-11 19:54:55,281 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c5d7f471612198bab87fbe1b067a8ab0, REOPEN/MOVE in 493 msec 2023-02-11 19:54:55,283 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-02-11 19:54:55,284 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 499 msec 2023-02-11 19:54:55,285 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 914 msec 2023-02-11 19:54:55,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-02-11 19:54:55,287 INFO [Listener at localhost/32929] compactions.TestMobCompactor(278): alter status finished 2023-02-11 19:54:55,288 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40445] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 19:54:55,289 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 19:54:55,290 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 19:54:55,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:54:55,290 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676145895290 2023-02-11 19:54:55,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 19:54:55,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-11 19:54:55,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 19:54:55,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] zookeeper.ReadOnlyZKClient(139): Connect 0x3f82bce3 to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:54:55,296 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@398fe649, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:54:55,296 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:55,296 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:55,296 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:55,296 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:55,296 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:55,296 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:55,296 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:55,296 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 19:54:55,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 19:54:55,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:54:55,297 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 19:54:55,298 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 8 msec 2023-02-11 19:54:55,358 INFO [Listener at localhost/32929] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=243 (was 246), OpenFileDescriptor=613 (was 600) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=243 (was 293), ProcessCount=168 (was 168), AvailableMemoryMB=3611 (was 3626) 2023-02-11 19:54:55,369 INFO [Listener at localhost/32929] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=243, OpenFileDescriptor=613, MaxFileDescriptor=60000, SystemLoadAverage=243, ProcessCount=168, AvailableMemoryMB=3610 2023-02-11 19:54:55,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-11 19:54:55,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:55,372 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:54:55,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-02-11 19:54:55,373 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:54:55,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-11 19:54:55,374 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:54:55,375 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7 empty. 2023-02-11 19:54:55,375 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:54:55,375 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-02-11 19:54:55,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-11 19:54:55,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-11 19:54:55,783 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-11 19:54:55,784 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7671): creating {ENCODED => 43d4d223fc2e23c806b3e24d0b9e14e7, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp 2023-02-11 19:54:55,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-11 19:54:56,189 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:54:56,189 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1603): Closing 43d4d223fc2e23c806b3e24d0b9e14e7, disabling compactions & flushes 2023-02-11 19:54:56,189 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:54:56,189 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:54:56,190 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. after waiting 0 ms 2023-02-11 19:54:56,190 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:54:56,190 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:54:56,190 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1557): Region close journal for 43d4d223fc2e23c806b3e24d0b9e14e7: Waiting for close lock at 1676145296189Disabling compacts and flushes for region at 1676145296189Disabling writes for close at 1676145296190 (+1 ms)Writing region close event to WAL at 1676145296190Closed at 1676145296190 2023-02-11 19:54:56,192 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:54:56,193 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676145296192"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145296192"}]},"ts":"1676145296192"} 2023-02-11 19:54:56,194 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 19:54:56,194 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:54:56,194 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145296194"}]},"ts":"1676145296194"} 2023-02-11 19:54:56,195 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-02-11 19:54:56,198 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=43d4d223fc2e23c806b3e24d0b9e14e7, ASSIGN}] 2023-02-11 19:54:56,199 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=43d4d223fc2e23c806b3e24d0b9e14e7, ASSIGN 2023-02-11 19:54:56,200 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=43d4d223fc2e23c806b3e24d0b9e14e7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=false 2023-02-11 19:54:56,351 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=43d4d223fc2e23c806b3e24d0b9e14e7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:56,351 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676145296351"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145296351"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145296351"}]},"ts":"1676145296351"} 2023-02-11 19:54:56,352 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 43d4d223fc2e23c806b3e24d0b9e14e7, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:54:56,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-11 19:54:56,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:54:56,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 43d4d223fc2e23c806b3e24d0b9e14e7, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:54:56,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:54:56,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:54:56,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:54:56,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:54:56,508 INFO [StoreOpener-43d4d223fc2e23c806b3e24d0b9e14e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:54:56,509 DEBUG [StoreOpener-43d4d223fc2e23c806b3e24d0b9e14e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1 2023-02-11 19:54:56,509 DEBUG [StoreOpener-43d4d223fc2e23c806b3e24d0b9e14e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1 2023-02-11 19:54:56,509 INFO [StoreOpener-43d4d223fc2e23c806b3e24d0b9e14e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43d4d223fc2e23c806b3e24d0b9e14e7 columnFamilyName family1 2023-02-11 19:54:56,511 INFO [StoreOpener-43d4d223fc2e23c806b3e24d0b9e14e7-1] regionserver.HStore(310): Store=43d4d223fc2e23c806b3e24d0b9e14e7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:54:56,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:54:56,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:54:56,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:54:56,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:54:56,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 43d4d223fc2e23c806b3e24d0b9e14e7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67653630, jitterRate=0.008117645978927612}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:54:56,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 43d4d223fc2e23c806b3e24d0b9e14e7: Running coprocessor pre-open hook at 1676145296507Writing region info on filesystem at 1676145296507Initializing all the Stores at 1676145296508 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676145296508Cleaning up temporary data from old regions at 1676145296512 (+4 ms)Cleaning up detritus from prior splits at 1676145296512Running coprocessor post-open hooks at 1676145296516 (+4 ms)Region opened successfully at 1676145296516 2023-02-11 19:54:56,517 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7., pid=57, masterSystemTime=1676145296504 2023-02-11 19:54:56,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:54:56,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:54:56,519 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=43d4d223fc2e23c806b3e24d0b9e14e7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:56,519 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676145296519"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145296519"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145296519"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145296519"}]},"ts":"1676145296519"} 2023-02-11 19:54:56,521 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-02-11 19:54:56,521 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 43d4d223fc2e23c806b3e24d0b9e14e7, server=jenkins-hbase4.apache.org,45897,1676145215747 in 168 msec 2023-02-11 19:54:56,522 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-02-11 19:54:56,522 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=43d4d223fc2e23c806b3e24d0b9e14e7, ASSIGN in 323 msec 2023-02-11 19:54:56,523 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:54:56,523 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145296523"}]},"ts":"1676145296523"} 2023-02-11 19:54:56,524 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-02-11 19:54:56,526 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:54:56,527 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1560 sec 2023-02-11 19:54:57,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-11 19:54:57,477 INFO [Listener at localhost/32929] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-02-11 19:54:57,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:57,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:57,496 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 19:54:57,496 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:57,496 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 19:54:57,496 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 19:54:57,497 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:57,497 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:57,499 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:57,499 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:57,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:57,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:57,499 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:57,500 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:57,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:57,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:57,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:57,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:57,500 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:57,500 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:57,501 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 19:54:57,501 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:57,501 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 19:54:57,501 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:57,501 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:57,501 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:54:57,501 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. started... 2023-02-11 19:54:57,502 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 43d4d223fc2e23c806b3e24d0b9e14e7 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-11 19:54:57,923 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511300c5ccdb0ee824a3e97ad367b8c9e6811 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511300c5ccdb0ee824a3e97ad367b8c9e6811 2023-02-11 19:54:58,327 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp/family1/a15f7769f7124b4b8b6b18b08ca11f1a 2023-02-11 19:54:58,331 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp/family1/a15f7769f7124b4b8b6b18b08ca11f1a as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/a15f7769f7124b4b8b6b18b08ca11f1a 2023-02-11 19:54:58,335 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/a15f7769f7124b4b8b6b18b08ca11f1a, entries=1000, sequenceid=5, filesize=190.5 K 2023-02-11 19:54:58,336 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 43d4d223fc2e23c806b3e24d0b9e14e7 in 834ms, sequenceid=5, compaction requested=false 2023-02-11 19:54:58,336 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 19:54:58,336 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 43d4d223fc2e23c806b3e24d0b9e14e7: 2023-02-11 19:54:58,336 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:54:58,336 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:58,337 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:58,337 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:58,337 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 19:54:58,337 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 19:54:58,338 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,338 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:58,339 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,339 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:58,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:58,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 19:54:58,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21b7f13f[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:58,340 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 19:54:58,340 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,341 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,341 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 19:54:58,341 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 19:54:58,341 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:58,341 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:58,341 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:58,343 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:58,343 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 19:54:58,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:58,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:58,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:58,343 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:58,343 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 19:54:58,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:58,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:58,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:58,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:58,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:58,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:58,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 19:54:58,345 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 19:54:58,345 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:58,345 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:58,345 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,345 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:58,348 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,348 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:58,348 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:58,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:58,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:58,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:58,348 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:58,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:58,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:58,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,349 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:58,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:58,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:58,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:58,354 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:58,354 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:58,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:58,354 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,354 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:58,354 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:58,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 19:54:58,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:58,354 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:58,355 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-11 19:54:58,355 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:58,355 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,355 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,355 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:58,355 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:58,355 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:58,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:58,455 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:58,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:58,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:58,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:58,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,465 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 19:54:58,465 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:58,465 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 19:54:58,465 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 19:54:58,465 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,465 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,466 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:58,466 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:58,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:58,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:58,467 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:58,467 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:58,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,467 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:58,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,468 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,476 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 19:54:58,476 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:58,476 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 19:54:58,476 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:58,476 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 19:54:58,476 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:58,476 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:58,476 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:54:58,476 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. started... 2023-02-11 19:54:58,476 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 43d4d223fc2e23c806b3e24d0b9e14e7 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-11 19:54:58,623 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 19:54:58,890 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128affcf201b8a94117826baae43def779e to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128affcf201b8a94117826baae43def779e 2023-02-11 19:54:59,298 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp/family1/29f58b6bab89457fb91227bbc861be0f 2023-02-11 19:54:59,303 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp/family1/29f58b6bab89457fb91227bbc861be0f as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/29f58b6bab89457fb91227bbc861be0f 2023-02-11 19:54:59,307 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/29f58b6bab89457fb91227bbc861be0f, entries=1, sequenceid=9, filesize=5.0 K 2023-02-11 19:54:59,307 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 43d4d223fc2e23c806b3e24d0b9e14e7 in 831ms, sequenceid=9, compaction requested=false 2023-02-11 19:54:59,307 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 43d4d223fc2e23c806b3e24d0b9e14e7: 2023-02-11 19:54:59,308 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:54:59,308 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:54:59,308 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:54:59,308 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:59,308 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 19:54:59,308 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 19:54:59,309 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:59,309 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:59,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:59,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:59,310 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:59,310 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:54:59,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:59,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:59,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:59,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 19:54:59,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2456cf4[Count = 0] remaining members to acquire global barrier 2023-02-11 19:54:59,311 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 19:54:59,311 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,316 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,316 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 19:54:59,316 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 19:54:59,316 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:54:59,316 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:59,316 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:54:59,318 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 19:54:59,318 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:59,318 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:59,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:59,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:59,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:59,318 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 19:54:59,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:59,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:59,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:59,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:59,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:59,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:54:59,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 19:54:59,320 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 19:54:59,320 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:54:59,320 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:54:59,320 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,320 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:54:59,321 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,321 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:54:59,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:54:59,321 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:59,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:54:59,322 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:59,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:59,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:59,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:54:59,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,323 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:59,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:59,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:54:59,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:59,325 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:59,325 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,325 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,325 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:59,325 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:59,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:59,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:59,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 19:54:59,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:54:59,325 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-11 19:54:59,325 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,325 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:54:59,325 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:54:59,325 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,325 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 19:54:59,325 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:54:59,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:54:59,325 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:54:59,425 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:54:59,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:54:59,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:54:59,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 19:54:59,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,431 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 19:54:59,431 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:59,431 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 19:54:59,431 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 19:54:59,432 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,432 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,434 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:59,434 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:54:59,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:54:59,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:54:59,434 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:54:59,434 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:54:59,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,435 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:54:59,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,435 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,435 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 19:54:59,435 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:54:59,435 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 19:54:59,435 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:54:59,435 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 19:54:59,436 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:54:59,436 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:54:59,436 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:54:59,436 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. started... 2023-02-11 19:54:59,436 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 43d4d223fc2e23c806b3e24d0b9e14e7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:54:59,849 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201599de6d73d3f4893bcc2e0480a48b62c to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201599de6d73d3f4893bcc2e0480a48b62c 2023-02-11 19:55:00,254 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp/family1/88c3817775544755bee75bac2d87479d 2023-02-11 19:55:00,258 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp/family1/88c3817775544755bee75bac2d87479d as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/88c3817775544755bee75bac2d87479d 2023-02-11 19:55:00,262 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/88c3817775544755bee75bac2d87479d, entries=1, sequenceid=13, filesize=5.0 K 2023-02-11 19:55:00,263 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 43d4d223fc2e23c806b3e24d0b9e14e7 in 827ms, sequenceid=13, compaction requested=true 2023-02-11 19:55:00,263 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 43d4d223fc2e23c806b3e24d0b9e14e7: 2023-02-11 19:55:00,263 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:00,263 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:55:00,263 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:55:00,263 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:00,263 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 19:55:00,263 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 19:55:00,264 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,264 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:00,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:00,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:00,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:00,265 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,265 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:55:00,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:00,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:00,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:00,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:00,266 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 19:55:00,266 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34b3db8e[Count = 0] remaining members to acquire global barrier 2023-02-11 19:55:00,266 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 19:55:00,266 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,267 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,267 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 19:55:00,267 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 19:55:00,267 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:55:00,267 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:00,267 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:55:00,269 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:00,269 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 19:55:00,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:00,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:00,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:00,269 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:00,269 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 19:55:00,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:00,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:00,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:00,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:00,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:00,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:55:00,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 19:55:00,271 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 19:55:00,271 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:55:00,271 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:55:00,271 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,271 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:55:00,274 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,274 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:00,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,274 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:00,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:00,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:00,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:00,274 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:00,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:00,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:00,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,275 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:00,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:00,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:00,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:00,278 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:00,278 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,278 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:00,278 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:00,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-11 19:55:00,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:00,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 19:55:00,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:55:00,278 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:00,278 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:00,278 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:00,278 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:00,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:00,278 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 19:55:00,278 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,278 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:55:00,278 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,379 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:55:00,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:55:00,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:55:00,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 19:55:00,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,384 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 19:55:00,384 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:00,384 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 19:55:00,384 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 19:55:00,384 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,384 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,386 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:00,386 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:00,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:00,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:00,386 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:00,386 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:55:00,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:55:00,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,387 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,387 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 19:55:00,387 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:00,387 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 19:55:00,387 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:00,387 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 19:55:00,387 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:55:00,387 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:55:00,387 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:00,387 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. started... 2023-02-11 19:55:00,387 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 43d4d223fc2e23c806b3e24d0b9e14e7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:55:00,798 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052ac174c4b5d84eb89da046a8045a2504 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512052ac174c4b5d84eb89da046a8045a2504 2023-02-11 19:55:01,203 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp/family1/4dd8eaeb1bf4415e98c18d29898c32d2 2023-02-11 19:55:01,208 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp/family1/4dd8eaeb1bf4415e98c18d29898c32d2 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/4dd8eaeb1bf4415e98c18d29898c32d2 2023-02-11 19:55:01,212 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/4dd8eaeb1bf4415e98c18d29898c32d2, entries=1, sequenceid=17, filesize=5.0 K 2023-02-11 19:55:01,212 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 43d4d223fc2e23c806b3e24d0b9e14e7 in 825ms, sequenceid=17, compaction requested=true 2023-02-11 19:55:01,213 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 43d4d223fc2e23c806b3e24d0b9e14e7: 2023-02-11 19:55:01,213 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:01,213 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:55:01,213 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:55:01,213 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:01,213 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 19:55:01,213 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 19:55:01,214 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,214 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:01,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:01,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:01,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:01,215 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,215 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:55:01,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:01,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:01,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:01,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:01,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 19:55:01,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c03adc9[Count = 0] remaining members to acquire global barrier 2023-02-11 19:55:01,216 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 19:55:01,216 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,220 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,220 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 19:55:01,220 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 19:55:01,220 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:01,220 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:55:01,220 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:55:01,221 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:01,221 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 19:55:01,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:01,221 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:01,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:01,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:01,221 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 19:55:01,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:01,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:01,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:01,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:01,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:01,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:55:01,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 19:55:01,223 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 19:55:01,223 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:55:01,223 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:55:01,223 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,223 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:55:01,225 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,225 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,225 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:01,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:01,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:01,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,225 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:01,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:01,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:01,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:01,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:01,226 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:01,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:01,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:01,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:01,228 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:01,228 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,228 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:01,228 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:01,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 19:55:01,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:55:01,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:01,228 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:01,228 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:01,229 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,229 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,228 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:01,229 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 19:55:01,229 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,229 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:55:01,229 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-11 19:55:01,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:01,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:01,329 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:55:01,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:55:01,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:55:01,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 19:55:01,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,335 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 19:55:01,335 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:01,335 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 19:55:01,335 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 19:55:01,335 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,335 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,337 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:01,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:01,338 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:01,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:01,338 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:01,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,338 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:55:01,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:55:01,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,339 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,339 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 19:55:01,339 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:01,339 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 19:55:01,339 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:01,339 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 19:55:01,339 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:55:01,339 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:55:01,339 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:01,339 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. started... 2023-02-11 19:55:01,339 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 43d4d223fc2e23c806b3e24d0b9e14e7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:55:01,751 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512287c80f28bd34b4b20a3f431307414d8d9 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512287c80f28bd34b4b20a3f431307414d8d9 2023-02-11 19:55:02,156 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp/family1/cb3b89ecc9e6494ebed406742c900e93 2023-02-11 19:55:02,161 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp/family1/cb3b89ecc9e6494ebed406742c900e93 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/cb3b89ecc9e6494ebed406742c900e93 2023-02-11 19:55:02,165 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/cb3b89ecc9e6494ebed406742c900e93, entries=1, sequenceid=21, filesize=5.0 K 2023-02-11 19:55:02,166 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 43d4d223fc2e23c806b3e24d0b9e14e7 in 827ms, sequenceid=21, compaction requested=true 2023-02-11 19:55:02,166 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 43d4d223fc2e23c806b3e24d0b9e14e7: 2023-02-11 19:55:02,166 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:02,166 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:55:02,166 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:55:02,166 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:02,166 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 19:55:02,166 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 19:55:02,168 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:02,168 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:02,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:02,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:02,168 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,168 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:55:02,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:02,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:02,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:02,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:02,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 19:55:02,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5223837f[Count = 0] remaining members to acquire global barrier 2023-02-11 19:55:02,169 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 19:55:02,170 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,171 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,171 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 19:55:02,171 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 19:55:02,171 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:55:02,171 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:02,171 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:55:02,172 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:02,172 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 19:55:02,172 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:02,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:02,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:02,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:02,172 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 19:55:02,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:02,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:02,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:02,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:02,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:02,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:55:02,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 19:55:02,174 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 19:55:02,174 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:55:02,175 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:55:02,175 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,175 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:55:02,178 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,178 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:02,178 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:02,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:02,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:02,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:02,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:02,178 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:02,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:02,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:02,179 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:02,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:02,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:02,182 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:02,182 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:02,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:02,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 19:55:02,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:55:02,182 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:02,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:02,182 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:02,182 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,182 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,182 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:02,182 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,182 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,183 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,183 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 19:55:02,183 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:55:02,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:02,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:02,283 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:55:02,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:55:02,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:55:02,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 19:55:02,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,288 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 19:55:02,288 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:02,289 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 19:55:02,289 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 19:55:02,289 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,289 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,290 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:02,290 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:02,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:02,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:02,291 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:02,291 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:55:02,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:55:02,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,291 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,292 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 19:55:02,292 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:02,292 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 19:55:02,292 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:02,292 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 19:55:02,292 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:55:02,292 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:55:02,292 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:02,292 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. started... 2023-02-11 19:55:02,292 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 43d4d223fc2e23c806b3e24d0b9e14e7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:55:02,706 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231657534df2e5043ce9876fde088bdf34a to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231657534df2e5043ce9876fde088bdf34a 2023-02-11 19:55:03,112 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp/family1/689bce58e9d34ebaa17ff02578e06432 2023-02-11 19:55:03,117 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp/family1/689bce58e9d34ebaa17ff02578e06432 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/689bce58e9d34ebaa17ff02578e06432 2023-02-11 19:55:03,122 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/689bce58e9d34ebaa17ff02578e06432, entries=1, sequenceid=25, filesize=5.0 K 2023-02-11 19:55:03,122 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 43d4d223fc2e23c806b3e24d0b9e14e7 in 830ms, sequenceid=25, compaction requested=true 2023-02-11 19:55:03,122 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 43d4d223fc2e23c806b3e24d0b9e14e7: 2023-02-11 19:55:03,122 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:03,122 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:55:03,123 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:55:03,123 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:03,123 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 19:55:03,123 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 19:55:03,124 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,124 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:03,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:03,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:03,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:03,124 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,125 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:55:03,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:03,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:03,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:03,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:03,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 19:55:03,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b287703[Count = 0] remaining members to acquire global barrier 2023-02-11 19:55:03,126 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 19:55:03,126 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,127 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,127 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 19:55:03,127 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 19:55:03,127 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:55:03,127 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:03,127 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:55:03,128 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 19:55:03,128 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:03,128 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:03,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:03,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:03,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:03,128 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 19:55:03,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:03,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:03,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:03,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:03,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:03,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:55:03,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 19:55:03,130 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 19:55:03,130 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:55:03,130 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:55:03,130 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,130 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:55:03,133 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,133 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:03,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:03,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,133 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:03,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:03,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:03,133 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:03,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:03,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:03,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,135 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:03,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:03,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:03,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:03,139 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:03,139 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,139 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,139 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:03,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 19:55:03,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:03,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:55:03,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:03,139 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:03,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-11 19:55:03,139 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:03,140 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 19:55:03,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:03,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:03,139 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:03,140 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:55:03,140 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,140 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,140 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,240 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:55:03,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:55:03,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:55:03,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 19:55:03,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,246 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 19:55:03,246 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:03,246 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 19:55:03,246 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 19:55:03,246 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,246 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,251 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:03,252 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:03,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:03,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:03,252 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:03,252 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:55:03,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,252 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:55:03,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,253 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,253 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 19:55:03,253 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:03,253 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 19:55:03,253 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:03,253 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 19:55:03,253 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:55:03,253 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:55:03,253 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:03,253 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. started... 2023-02-11 19:55:03,253 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 43d4d223fc2e23c806b3e24d0b9e14e7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:55:03,665 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101d460b26228984834b6e4fb4eb31577e1 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101d460b26228984834b6e4fb4eb31577e1 2023-02-11 19:55:04,070 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp/family1/235ac715e3594c8bbececec55ebb0a6a 2023-02-11 19:55:04,074 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp/family1/235ac715e3594c8bbececec55ebb0a6a as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/235ac715e3594c8bbececec55ebb0a6a 2023-02-11 19:55:04,078 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/235ac715e3594c8bbececec55ebb0a6a, entries=1, sequenceid=29, filesize=5.0 K 2023-02-11 19:55:04,079 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 43d4d223fc2e23c806b3e24d0b9e14e7 in 826ms, sequenceid=29, compaction requested=true 2023-02-11 19:55:04,079 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 43d4d223fc2e23c806b3e24d0b9e14e7: 2023-02-11 19:55:04,079 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:04,079 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:55:04,079 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:55:04,079 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:04,079 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 19:55:04,079 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 19:55:04,081 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:04,081 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:04,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:04,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:04,081 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,081 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:55:04,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:04,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:04,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:04,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:04,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 19:55:04,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@516dac43[Count = 0] remaining members to acquire global barrier 2023-02-11 19:55:04,083 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 19:55:04,083 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,084 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,084 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 19:55:04,084 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:04,084 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:55:04,084 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 19:55:04,084 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:55:04,085 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:04,085 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 19:55:04,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:04,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:04,085 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:04,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:04,085 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 19:55:04,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:04,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:04,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:04,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:04,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:04,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:55:04,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 19:55:04,087 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 19:55:04,087 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:55:04,087 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:55:04,088 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,088 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:55:04,090 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,090 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:04,090 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:04,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:04,091 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:04,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:04,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:04,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,091 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:04,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:04,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:04,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:04,093 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:04,093 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:04,093 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:04,093 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:04,093 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:04,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:04,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 19:55:04,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:55:04,093 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-11 19:55:04,094 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:04,094 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:04,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:04,094 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,094 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 19:55:04,094 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:55:04,094 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,194 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:55:04,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:55:04,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:55:04,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 19:55:04,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,200 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 19:55:04,200 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:04,200 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 19:55:04,200 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 19:55:04,200 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,200 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,201 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:04,201 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:04,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:04,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:04,202 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:04,202 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:55:04,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:55:04,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,203 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,203 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 19:55:04,203 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:04,203 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 19:55:04,203 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:04,203 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 19:55:04,203 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:55:04,203 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:55:04,203 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:04,203 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. started... 2023-02-11 19:55:04,203 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 43d4d223fc2e23c806b3e24d0b9e14e7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:55:04,615 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103589b3feb1bb74234858aeaff3b6e96d8 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103589b3feb1bb74234858aeaff3b6e96d8 2023-02-11 19:55:05,020 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp/family1/f3f4c0d14b86434d87e9cd2fcf99f8f4 2023-02-11 19:55:05,024 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp/family1/f3f4c0d14b86434d87e9cd2fcf99f8f4 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/f3f4c0d14b86434d87e9cd2fcf99f8f4 2023-02-11 19:55:05,027 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/f3f4c0d14b86434d87e9cd2fcf99f8f4, entries=1, sequenceid=33, filesize=5.0 K 2023-02-11 19:55:05,028 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 43d4d223fc2e23c806b3e24d0b9e14e7 in 825ms, sequenceid=33, compaction requested=true 2023-02-11 19:55:05,028 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 43d4d223fc2e23c806b3e24d0b9e14e7: 2023-02-11 19:55:05,028 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:05,028 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:55:05,028 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:55:05,028 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,028 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 19:55:05,028 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 19:55:05,031 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,031 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:05,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:05,031 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,031 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:55:05,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:05,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:05,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:05,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 19:55:05,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d13e42[Count = 0] remaining members to acquire global barrier 2023-02-11 19:55:05,033 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 19:55:05,033 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,034 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,034 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 19:55:05,034 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 19:55:05,034 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:55:05,034 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,034 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:55:05,035 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,035 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 19:55:05,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:05,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:05,035 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:05,035 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 19:55:05,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:05,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:05,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:05,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:55:05,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 19:55:05,037 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 19:55:05,037 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:55:05,037 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:55:05,037 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,037 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:55:05,039 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,039 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:05,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:05,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,039 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:05,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:05,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:05,040 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:05,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:05,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,040 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:05,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,044 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,044 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:05,044 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,044 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:05,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-11 19:55:05,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:05,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:05,044 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:05,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 19:55:05,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:55:05,044 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,044 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,044 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:05,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:05,044 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,044 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,044 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 19:55:05,045 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:55:05,145 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:55:05,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:55:05,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:55:05,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 19:55:05,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,151 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 19:55:05,151 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:05,151 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 19:55:05,151 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 19:55:05,152 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,152 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,153 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,153 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:05,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:05,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:05,154 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,154 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:55:05,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:55:05,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,154 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,155 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 19:55:05,155 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,155 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 19:55:05,155 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:05,155 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 19:55:05,155 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:55:05,155 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:55:05,155 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:05,155 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. started... 2023-02-11 19:55:05,155 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 43d4d223fc2e23c806b3e24d0b9e14e7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:55:05,172 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907e27ef3bd08eb4800bf892e7517eb771b to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907e27ef3bd08eb4800bf892e7517eb771b 2023-02-11 19:55:05,179 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp/family1/2fee366ef28745c79052150d0dd4f991 2023-02-11 19:55:05,184 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp/family1/2fee366ef28745c79052150d0dd4f991 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/2fee366ef28745c79052150d0dd4f991 2023-02-11 19:55:05,187 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/2fee366ef28745c79052150d0dd4f991, entries=1, sequenceid=37, filesize=5.0 K 2023-02-11 19:55:05,188 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 43d4d223fc2e23c806b3e24d0b9e14e7 in 33ms, sequenceid=37, compaction requested=true 2023-02-11 19:55:05,188 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 43d4d223fc2e23c806b3e24d0b9e14e7: 2023-02-11 19:55:05,188 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:05,188 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:55:05,188 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:55:05,188 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,188 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 19:55:05,189 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 19:55:05,190 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,190 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:05,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:05,190 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,190 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:55:05,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:05,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:05,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:05,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 19:55:05,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e277d5c[Count = 0] remaining members to acquire global barrier 2023-02-11 19:55:05,192 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 19:55:05,192 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,194 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,194 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 19:55:05,194 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 19:55:05,194 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:55:05,194 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,194 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:55:05,195 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,195 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 19:55:05,195 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:05,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,196 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 19:55:05,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:05,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:05,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:05,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:05,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:05,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:55:05,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 19:55:05,198 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 19:55:05,198 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:55:05,198 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:55:05,198 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,198 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:55:05,199 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,199 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:05,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:05,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,199 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:05,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:05,200 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:05,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:05,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:05,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,201 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:05,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,203 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:05,203 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:05,203 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:05,203 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:05,203 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:05,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 19:55:05,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:55:05,203 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,204 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,204 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,204 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,204 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 19:55:05,204 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:55:05,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:05,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:05,204 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,205 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-11 19:55:05,304 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:55:05,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:55:05,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:55:05,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 19:55:05,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,309 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 19:55:05,310 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:05,310 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 19:55:05,310 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 19:55:05,310 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,310 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,317 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:05,317 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:05,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:05,317 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:05,318 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:55:05,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,318 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:55:05,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,318 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,318 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 19:55:05,318 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:05,318 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 19:55:05,318 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:05,318 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 19:55:05,319 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:55:05,319 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:55:05,319 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:05,319 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. started... 2023-02-11 19:55:05,319 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 43d4d223fc2e23c806b3e24d0b9e14e7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:55:05,737 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120927aca282d8f48abb37b6bd88ef80e29 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120927aca282d8f48abb37b6bd88ef80e29 2023-02-11 19:55:06,142 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp/family1/7d8f7c7fdb1149799e466fb515830c66 2023-02-11 19:55:06,146 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp/family1/7d8f7c7fdb1149799e466fb515830c66 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/7d8f7c7fdb1149799e466fb515830c66 2023-02-11 19:55:06,149 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/7d8f7c7fdb1149799e466fb515830c66, entries=1, sequenceid=41, filesize=5.0 K 2023-02-11 19:55:06,150 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 43d4d223fc2e23c806b3e24d0b9e14e7 in 831ms, sequenceid=41, compaction requested=true 2023-02-11 19:55:06,150 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 43d4d223fc2e23c806b3e24d0b9e14e7: 2023-02-11 19:55:06,150 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:06,150 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:55:06,150 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:55:06,150 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:06,150 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 19:55:06,150 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 19:55:06,151 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,151 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:06,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:06,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:06,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:06,152 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,152 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:55:06,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:06,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:06,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:06,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:06,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 19:55:06,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@760f9bf4[Count = 0] remaining members to acquire global barrier 2023-02-11 19:55:06,153 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 19:55:06,153 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,154 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,154 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 19:55:06,154 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 19:55:06,154 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:55:06,154 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:06,155 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:55:06,156 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 19:55:06,156 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:06,156 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:06,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:06,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:06,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:06,156 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 19:55:06,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:06,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:06,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:06,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:06,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:06,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:55:06,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 19:55:06,158 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 19:55:06,158 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:55:06,158 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:55:06,158 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,158 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:55:06,161 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,161 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:06,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:06,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,161 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:06,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:06,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:06,161 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:06,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:06,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:06,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,162 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:06,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:06,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:06,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:06,164 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:06,164 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:06,164 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,164 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:06,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 19:55:06,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:55:06,164 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-11 19:55:06,164 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:06,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:06,165 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 19:55:06,165 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:55:06,164 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:06,165 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:06,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:06,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:06,165 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,165 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,165 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,265 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:55:06,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:55:06,266 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40445] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:06,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 19:55:06,269 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 19:55:06,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:55:06,269 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676145906269 2023-02-11 19:55:06,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 19:55:06,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-11 19:55:06,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 19:55:06,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] zookeeper.ReadOnlyZKClient(139): Connect 0x1a603d21 to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:55:06,275 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61accd2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:55:06,276 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:07,108 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c66daa5fea804c8c8b502ae9601f2603 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103c66daa5fea804c8c8b502ae9601f2603 2023-02-11 19:55:07,108 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 19:55:07,121 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:55:07,122 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41460, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:55:07,128 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:55:07,129 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45046, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:55:07,137 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7458e895593345378b6f90b71471de9f first=Optional[r3] last=Optional[r6] 2023-02-11 19:55:07,137 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7458e895593345378b6f90b71471de9f}] 2023-02-11 19:55:07,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7458e895593345378b6f90b71471de9f for inclusion in 43d4d223fc2e23c806b3e24d0b9e14e7/family1 2023-02-11 19:55:07,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-11 19:55:07,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 19:55:07,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 43d4d223fc2e23c806b3e24d0b9e14e7: 2023-02-11 19:55:07,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7458e895593345378b6f90b71471de9f to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gfc49579dt0nodohg8d7a9ccqehjmmaebq1cega6detrgpl03gv7bg5ke2k9s40d/family1/7458e895593345378b6f90b71471de9f 2023-02-11 19:55:07,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gfc49579dt0nodohg8d7a9ccqehjmmaebq1cega6detrgpl03gv7bg5ke2k9s40d/family1/7458e895593345378b6f90b71471de9f as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/8e409c0b1f35491a80f07037df9e96bb_SeqId_44_ 2023-02-11 19:55:07,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gfc49579dt0nodohg8d7a9ccqehjmmaebq1cega6detrgpl03gv7bg5ke2k9s40d/family1/7458e895593345378b6f90b71471de9f into 43d4d223fc2e23c806b3e24d0b9e14e7/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/8e409c0b1f35491a80f07037df9e96bb_SeqId_44_ - updating store file list. 2023-02-11 19:55:07,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/8e409c0b1f35491a80f07037df9e96bb_SeqId_44_ into 43d4d223fc2e23c806b3e24d0b9e14e7/family1 2023-02-11 19:55:07,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gfc49579dt0nodohg8d7a9ccqehjmmaebq1cega6detrgpl03gv7bg5ke2k9s40d/family1/7458e895593345378b6f90b71471de9f into 43d4d223fc2e23c806b3e24d0b9e14e7/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/8e409c0b1f35491a80f07037df9e96bb_SeqId_44_) 2023-02-11 19:55:07,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gfc49579dt0nodohg8d7a9ccqehjmmaebq1cega6detrgpl03gv7bg5ke2k9s40d/family1/7458e895593345378b6f90b71471de9f 2023-02-11 19:55:07,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-11 19:55:07,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-11 19:55:07,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(1912): 43d4d223fc2e23c806b3e24d0b9e14e7/family1 is initiating minor compaction 2023-02-11 19:55:07,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4e8c7638; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:55:07,153 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 43d4d223fc2e23c806b3e24d0b9e14e7/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:07,153 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/29f58b6bab89457fb91227bbc861be0f, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/88c3817775544755bee75bac2d87479d, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/4dd8eaeb1bf4415e98c18d29898c32d2, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/cb3b89ecc9e6494ebed406742c900e93, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/689bce58e9d34ebaa17ff02578e06432, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/235ac715e3594c8bbececec55ebb0a6a, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/f3f4c0d14b86434d87e9cd2fcf99f8f4, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/2fee366ef28745c79052150d0dd4f991, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/7d8f7c7fdb1149799e466fb515830c66, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/8e409c0b1f35491a80f07037df9e96bb_SeqId_44_] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp, totalSize=50.3 K 2023-02-11 19:55:07,153 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 29f58b6bab89457fb91227bbc861be0f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 19:55:07,153 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 88c3817775544755bee75bac2d87479d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 19:55:07,153 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 4dd8eaeb1bf4415e98c18d29898c32d2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-11 19:55:07,153 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting cb3b89ecc9e6494ebed406742c900e93, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-11 19:55:07,153 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 689bce58e9d34ebaa17ff02578e06432, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-11 19:55:07,153 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 235ac715e3594c8bbececec55ebb0a6a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-11 19:55:07,153 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting f3f4c0d14b86434d87e9cd2fcf99f8f4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-11 19:55:07,153 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 2fee366ef28745c79052150d0dd4f991, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-11 19:55:07,153 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 7d8f7c7fdb1149799e466fb515830c66, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-11 19:55:07,153 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 8e409c0b1f35491a80f07037df9e96bb_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-11 19:55:07,154 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 19:55:07,155 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:07,156 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512287c80f28bd34b4b20a3f431307414d8d9 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512287c80f28bd34b4b20a3f431307414d8d9 2023-02-11 19:55:07,157 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231657534df2e5043ce9876fde088bdf34a to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231657534df2e5043ce9876fde088bdf34a 2023-02-11 19:55:07,158 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101d460b26228984834b6e4fb4eb31577e1 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101d460b26228984834b6e4fb4eb31577e1 2023-02-11 19:55:07,159 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103589b3feb1bb74234858aeaff3b6e96d8 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103589b3feb1bb74234858aeaff3b6e96d8 2023-02-11 19:55:07,159 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-02-11 19:55:07,159 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-11 19:55:07,160 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:07,160 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:07,160 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:07,160 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:07,160 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:07,160 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:07,160 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:07,160 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:07,185 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] throttle.PressureAwareThroughputController(145): 43d4d223fc2e23c806b3e24d0b9e14e7#family1#compaction#73 average throughput is 1.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-02-11 19:55:07,608 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp/family1/a29d9a3900a54414836d52b05cbc25c4 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/a29d9a3900a54414836d52b05cbc25c4 2023-02-11 19:55:07,609 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205757b75f3731f41d5ad0fcc961eb294a1 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205757b75f3731f41d5ad0fcc961eb294a1 2023-02-11 19:55:07,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 19:55:07,613 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 43d4d223fc2e23c806b3e24d0b9e14e7/family1 of 43d4d223fc2e23c806b3e24d0b9e14e7 into a29d9a3900a54414836d52b05cbc25c4(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 19:55:07,613 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 43d4d223fc2e23c806b3e24d0b9e14e7: 2023-02-11 19:55:07,613 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1676145307153; duration=0sec 2023-02-11 19:55:07,613 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:55:07,632 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/29f58b6bab89457fb91227bbc861be0f, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/88c3817775544755bee75bac2d87479d, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/4dd8eaeb1bf4415e98c18d29898c32d2, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/cb3b89ecc9e6494ebed406742c900e93, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/689bce58e9d34ebaa17ff02578e06432, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/235ac715e3594c8bbececec55ebb0a6a, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/f3f4c0d14b86434d87e9cd2fcf99f8f4, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/2fee366ef28745c79052150d0dd4f991, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/7d8f7c7fdb1149799e466fb515830c66, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/8e409c0b1f35491a80f07037df9e96bb_SeqId_44_] to archive 2023-02-11 19:55:07,633 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:07,634 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/29f58b6bab89457fb91227bbc861be0f to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/29f58b6bab89457fb91227bbc861be0f 2023-02-11 19:55:07,636 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/88c3817775544755bee75bac2d87479d to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/88c3817775544755bee75bac2d87479d 2023-02-11 19:55:07,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/4dd8eaeb1bf4415e98c18d29898c32d2 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/4dd8eaeb1bf4415e98c18d29898c32d2 2023-02-11 19:55:07,638 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/cb3b89ecc9e6494ebed406742c900e93 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/cb3b89ecc9e6494ebed406742c900e93 2023-02-11 19:55:07,640 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/689bce58e9d34ebaa17ff02578e06432 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/689bce58e9d34ebaa17ff02578e06432 2023-02-11 19:55:07,641 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/235ac715e3594c8bbececec55ebb0a6a to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/235ac715e3594c8bbececec55ebb0a6a 2023-02-11 19:55:07,642 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/f3f4c0d14b86434d87e9cd2fcf99f8f4 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/f3f4c0d14b86434d87e9cd2fcf99f8f4 2023-02-11 19:55:07,644 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/2fee366ef28745c79052150d0dd4f991 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/2fee366ef28745c79052150d0dd4f991 2023-02-11 19:55:07,645 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/7d8f7c7fdb1149799e466fb515830c66 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/7d8f7c7fdb1149799e466fb515830c66 2023-02-11 19:55:07,646 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/8e409c0b1f35491a80f07037df9e96bb_SeqId_44_ to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/8e409c0b1f35491a80f07037df9e96bb_SeqId_44_ 2023-02-11 19:55:07,651 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/db457d87e0c243df8e88ef9eebecb8d1 first=Optional[r00] last=Optional[r2] 2023-02-11 19:55:07,651 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/db457d87e0c243df8e88ef9eebecb8d1}] 2023-02-11 19:55:07,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/db457d87e0c243df8e88ef9eebecb8d1 for inclusion in 43d4d223fc2e23c806b3e24d0b9e14e7/family1 2023-02-11 19:55:07,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-11 19:55:07,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 19:55:07,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 43d4d223fc2e23c806b3e24d0b9e14e7: 2023-02-11 19:55:07,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/db457d87e0c243df8e88ef9eebecb8d1 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rv71up3tkjvlac7rq6kvns1f52j9occgj881kh1sacg1hhtu6tv3qv1b2vdc15ti/family1/db457d87e0c243df8e88ef9eebecb8d1 2023-02-11 19:55:07,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rv71up3tkjvlac7rq6kvns1f52j9occgj881kh1sacg1hhtu6tv3qv1b2vdc15ti/family1/db457d87e0c243df8e88ef9eebecb8d1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/8308e5d7eb9743d780677b7199f952f2_SeqId_47_ 2023-02-11 19:55:07,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rv71up3tkjvlac7rq6kvns1f52j9occgj881kh1sacg1hhtu6tv3qv1b2vdc15ti/family1/db457d87e0c243df8e88ef9eebecb8d1 into 43d4d223fc2e23c806b3e24d0b9e14e7/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/8308e5d7eb9743d780677b7199f952f2_SeqId_47_ - updating store file list. 2023-02-11 19:55:07,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/8308e5d7eb9743d780677b7199f952f2_SeqId_47_ into 43d4d223fc2e23c806b3e24d0b9e14e7/family1 2023-02-11 19:55:07,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rv71up3tkjvlac7rq6kvns1f52j9occgj881kh1sacg1hhtu6tv3qv1b2vdc15ti/family1/db457d87e0c243df8e88ef9eebecb8d1 into 43d4d223fc2e23c806b3e24d0b9e14e7/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/8308e5d7eb9743d780677b7199f952f2_SeqId_47_) 2023-02-11 19:55:07,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rv71up3tkjvlac7rq6kvns1f52j9occgj881kh1sacg1hhtu6tv3qv1b2vdc15ti/family1/db457d87e0c243df8e88ef9eebecb8d1 2023-02-11 19:55:07,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-11 19:55:07,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-11 19:55:07,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(1912): 43d4d223fc2e23c806b3e24d0b9e14e7/family1 is initiating minor compaction (all files) 2023-02-11 19:55:07,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@116a32f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:55:07,666 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 43d4d223fc2e23c806b3e24d0b9e14e7/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:07,666 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/a15f7769f7124b4b8b6b18b08ca11f1a, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/a29d9a3900a54414836d52b05cbc25c4, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/8308e5d7eb9743d780677b7199f952f2_SeqId_47_] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp, totalSize=388.1 K 2023-02-11 19:55:07,666 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting a15f7769f7124b4b8b6b18b08ca11f1a, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878840136 2023-02-11 19:55:07,666 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting a29d9a3900a54414836d52b05cbc25c4, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621240136 2023-02-11 19:55:07,667 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 8308e5d7eb9743d780677b7199f952f2_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878840136 2023-02-11 19:55:07,667 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 19:55:07,668 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:07,670 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511300c5ccdb0ee824a3e97ad367b8c9e6811 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511300c5ccdb0ee824a3e97ad367b8c9e6811 2023-02-11 19:55:07,671 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201599de6d73d3f4893bcc2e0480a48b62c to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201599de6d73d3f4893bcc2e0480a48b62c 2023-02-11 19:55:07,672 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512052ac174c4b5d84eb89da046a8045a2504 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512052ac174c4b5d84eb89da046a8045a2504 2023-02-11 19:55:07,672 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-02-11 19:55:07,672 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-11 19:55:07,673 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:07,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 19:55:07,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:55:07,674 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 19:55:07,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.4070 sec 2023-02-11 19:55:07,682 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] throttle.PressureAwareThroughputController(145): 43d4d223fc2e23c806b3e24d0b9e14e7#family1#compaction#74 average throughput is 29.94 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-02-11 19:55:07,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-11 19:55:07,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:08,145 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-11 19:55:08,146 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-11 19:55:08,146 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-11 19:55:08,148 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-11 19:55:08,150 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=43d4d223fc2e23c806b3e24d0b9e14e7, REOPEN/MOVE}] 2023-02-11 19:55:08,151 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=43d4d223fc2e23c806b3e24d0b9e14e7, REOPEN/MOVE 2023-02-11 19:55:08,151 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=43d4d223fc2e23c806b3e24d0b9e14e7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:08,152 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676145308151"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145308151"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145308151"}]},"ts":"1676145308151"} 2023-02-11 19:55:08,153 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 43d4d223fc2e23c806b3e24d0b9e14e7, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:55:08,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:55:08,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 43d4d223fc2e23c806b3e24d0b9e14e7, disabling compactions & flushes 2023-02-11 19:55:08,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:08,899 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/.tmp/family1/2558f752fcb34e31956e4c9cc59c9e89 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/2558f752fcb34e31956e4c9cc59c9e89 2023-02-11 19:55:08,903 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 43d4d223fc2e23c806b3e24d0b9e14e7/family1 of 43d4d223fc2e23c806b3e24d0b9e14e7 into 2558f752fcb34e31956e4c9cc59c9e89(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 19:55:08,904 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 43d4d223fc2e23c806b3e24d0b9e14e7: 2023-02-11 19:55:08,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:08,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:08,904 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1676145307665; duration=1sec 2023-02-11 19:55:08,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. after waiting 0 ms 2023-02-11 19:55:08,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:08,904 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:55:08,907 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/a15f7769f7124b4b8b6b18b08ca11f1a, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/a29d9a3900a54414836d52b05cbc25c4, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/8308e5d7eb9743d780677b7199f952f2_SeqId_47_] to archive 2023-02-11 19:55:08,907 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:08,909 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/a15f7769f7124b4b8b6b18b08ca11f1a to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/a15f7769f7124b4b8b6b18b08ca11f1a 2023-02-11 19:55:08,911 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/a29d9a3900a54414836d52b05cbc25c4 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/a29d9a3900a54414836d52b05cbc25c4 2023-02-11 19:55:08,912 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/8308e5d7eb9743d780677b7199f952f2_SeqId_47_ to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/8308e5d7eb9743d780677b7199f952f2_SeqId_47_ 2023-02-11 19:55:08,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-11 19:55:08,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:08,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 43d4d223fc2e23c806b3e24d0b9e14e7: Waiting for close lock at 1676145308304Running coprocessor pre-close hooks at 1676145308304Disabling compacts and flushes for region at 1676145308304Disabling writes for close at 1676145308904 (+600 ms)Writing region close event to WAL at 1676145308913 (+9 ms)Running coprocessor post-close hooks at 1676145308916 (+3 ms)Closed at 1676145308916 2023-02-11 19:55:08,916 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 43d4d223fc2e23c806b3e24d0b9e14e7 to self. 2023-02-11 19:55:08,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:55:08,918 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=43d4d223fc2e23c806b3e24d0b9e14e7, regionState=CLOSED 2023-02-11 19:55:08,918 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676145308918"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145308918"}]},"ts":"1676145308918"} 2023-02-11 19:55:08,920 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-02-11 19:55:08,920 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 43d4d223fc2e23c806b3e24d0b9e14e7, server=jenkins-hbase4.apache.org,45897,1676145215747 in 766 msec 2023-02-11 19:55:08,920 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=43d4d223fc2e23c806b3e24d0b9e14e7, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=true 2023-02-11 19:55:09,071 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=43d4d223fc2e23c806b3e24d0b9e14e7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:09,071 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676145309071"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145309071"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145309071"}]},"ts":"1676145309071"} 2023-02-11 19:55:09,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 43d4d223fc2e23c806b3e24d0b9e14e7, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:55:09,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:09,246 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:55:09,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 43d4d223fc2e23c806b3e24d0b9e14e7, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:55:09,246 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a603d21 to 127.0.0.1:64025 2023-02-11 19:55:09,246 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:55:09,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:55:09,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:55:09,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:55:09,248 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:55:09,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:55:09,248 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69eef449 to 127.0.0.1:64025 2023-02-11 19:55:09,248 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:55:09,250 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f82bce3 to 127.0.0.1:64025 2023-02-11 19:55:09,250 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:55:09,250 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:55:09,250 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x598c775b to 127.0.0.1:64025 2023-02-11 19:55:09,250 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:55:09,254 INFO [StoreOpener-43d4d223fc2e23c806b3e24d0b9e14e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:55:09,254 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:55:09,255 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a35b423 to 127.0.0.1:64025 2023-02-11 19:55:09,255 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:55:09,256 DEBUG [StoreOpener-43d4d223fc2e23c806b3e24d0b9e14e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1 2023-02-11 19:55:09,256 DEBUG [StoreOpener-43d4d223fc2e23c806b3e24d0b9e14e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1 2023-02-11 19:55:09,256 INFO [StoreOpener-43d4d223fc2e23c806b3e24d0b9e14e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43d4d223fc2e23c806b3e24d0b9e14e7 columnFamilyName family1 2023-02-11 19:55:09,260 DEBUG [StoreOpener-43d4d223fc2e23c806b3e24d0b9e14e7-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/2558f752fcb34e31956e4c9cc59c9e89 2023-02-11 19:55:09,261 INFO [StoreOpener-43d4d223fc2e23c806b3e24d0b9e14e7-1] regionserver.HStore(310): Store=43d4d223fc2e23c806b3e24d0b9e14e7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:55:09,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:55:09,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:55:09,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:55:09,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 43d4d223fc2e23c806b3e24d0b9e14e7; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59464357, jitterRate=-0.11391203105449677}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:55:09,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 43d4d223fc2e23c806b3e24d0b9e14e7: Running coprocessor pre-open hook at 1676145309248Writing region info on filesystem at 1676145309248Initializing all the Stores at 1676145309250 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676145309251 (+1 ms)Cleaning up temporary data from old regions at 1676145309262 (+11 ms)Cleaning up detritus from prior splits at 1676145309263 (+1 ms)Running coprocessor post-open hooks at 1676145309265 (+2 ms)Region opened successfully at 1676145309265 2023-02-11 19:55:09,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7., pid=63, masterSystemTime=1676145309224 2023-02-11 19:55:09,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:09,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:09,267 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=43d4d223fc2e23c806b3e24d0b9e14e7, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:09,267 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676145309267"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145309267"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145309267"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145309267"}]},"ts":"1676145309267"} 2023-02-11 19:55:09,270 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-02-11 19:55:09,270 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 43d4d223fc2e23c806b3e24d0b9e14e7, server=jenkins-hbase4.apache.org,45897,1676145215747 in 197 msec 2023-02-11 19:55:09,271 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-02-11 19:55:09,271 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=43d4d223fc2e23c806b3e24d0b9e14e7, REOPEN/MOVE in 1.1200 sec 2023-02-11 19:55:09,272 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-02-11 19:55:09,272 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1230 sec 2023-02-11 19:55:09,273 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5370 sec 2023-02-11 19:55:09,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-02-11 19:55:09,275 INFO [Listener at localhost/32929] compactions.TestMobCompactor(278): alter status finished 2023-02-11 19:55:09,276 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40445] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:09,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 19:55:09,277 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 19:55:09,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:55:09,278 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676145909278 2023-02-11 19:55:09,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 19:55:09,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-11 19:55:09,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 19:55:09,279 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] zookeeper.ReadOnlyZKClient(139): Connect 0x496ff499 to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:55:09,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b5d88d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:55:09,283 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:09,283 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:09,283 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:09,283 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:09,283 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:10,107 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128cb4c7fdf206c4678b8c8c598b4f4b177 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128cb4c7fdf206c4678b8c8c598b4f4b177 2023-02-11 19:55:10,108 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 19:55:10,125 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:55:10,126 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41468, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:55:10,133 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:55:10,135 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45054, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:55:10,143 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e6f716815df2431aa8145445d8fefd74 first=Optional[r05] last=Optional[r8] 2023-02-11 19:55:10,143 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=51 for row with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e6f716815df2431aa8145445d8fefd74}] 2023-02-11 19:55:10,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e6f716815df2431aa8145445d8fefd74 for inclusion in 43d4d223fc2e23c806b3e24d0b9e14e7/family1 2023-02-11 19:55:10,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-11 19:55:10,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 19:55:10,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 43d4d223fc2e23c806b3e24d0b9e14e7: 2023-02-11 19:55:10,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e6f716815df2431aa8145445d8fefd74 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__su3ihjojunan1d6rk5ocuqh6pfquql4b0k586pgco11p26g6gcmucclgphlo7e4b/family1/e6f716815df2431aa8145445d8fefd74 2023-02-11 19:55:10,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__su3ihjojunan1d6rk5ocuqh6pfquql4b0k586pgco11p26g6gcmucclgphlo7e4b/family1/e6f716815df2431aa8145445d8fefd74 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/9fb7b1f26aea4931ae90b83809ce323c_SeqId_53_ 2023-02-11 19:55:10,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__su3ihjojunan1d6rk5ocuqh6pfquql4b0k586pgco11p26g6gcmucclgphlo7e4b/family1/e6f716815df2431aa8145445d8fefd74 into 43d4d223fc2e23c806b3e24d0b9e14e7/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/9fb7b1f26aea4931ae90b83809ce323c_SeqId_53_ - updating store file list. 2023-02-11 19:55:10,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/9fb7b1f26aea4931ae90b83809ce323c_SeqId_53_ into 43d4d223fc2e23c806b3e24d0b9e14e7/family1 2023-02-11 19:55:10,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__su3ihjojunan1d6rk5ocuqh6pfquql4b0k586pgco11p26g6gcmucclgphlo7e4b/family1/e6f716815df2431aa8145445d8fefd74 into 43d4d223fc2e23c806b3e24d0b9e14e7/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/9fb7b1f26aea4931ae90b83809ce323c_SeqId_53_) 2023-02-11 19:55:10,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__su3ihjojunan1d6rk5ocuqh6pfquql4b0k586pgco11p26g6gcmucclgphlo7e4b/family1/e6f716815df2431aa8145445d8fefd74 2023-02-11 19:55:10,159 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 19:55:10,160 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:10,161 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120927aca282d8f48abb37b6bd88ef80e29 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120927aca282d8f48abb37b6bd88ef80e29 2023-02-11 19:55:10,162 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128affcf201b8a94117826baae43def779e to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128affcf201b8a94117826baae43def779e 2023-02-11 19:55:10,162 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-02-11 19:55:10,162 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-11 19:55:10,163 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:10,163 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:10,163 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:10,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 19:55:10,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:55:10,164 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 19:55:10,165 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 888 msec 2023-02-11 19:55:10,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-02-11 19:55:10,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:10,631 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-11 19:55:10,632 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-11 19:55:10,632 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-11 19:55:10,634 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-11 19:55:10,636 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=43d4d223fc2e23c806b3e24d0b9e14e7, REOPEN/MOVE}] 2023-02-11 19:55:10,636 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=43d4d223fc2e23c806b3e24d0b9e14e7, REOPEN/MOVE 2023-02-11 19:55:10,637 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=43d4d223fc2e23c806b3e24d0b9e14e7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:10,637 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676145310637"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145310637"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145310637"}]},"ts":"1676145310637"} 2023-02-11 19:55:10,638 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 43d4d223fc2e23c806b3e24d0b9e14e7, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:55:10,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:55:10,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 43d4d223fc2e23c806b3e24d0b9e14e7, disabling compactions & flushes 2023-02-11 19:55:10,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:10,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:10,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. after waiting 0 ms 2023-02-11 19:55:10,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:10,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-11 19:55:10,797 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:10,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 43d4d223fc2e23c806b3e24d0b9e14e7: Waiting for close lock at 1676145310789Running coprocessor pre-close hooks at 1676145310789Disabling compacts and flushes for region at 1676145310789Disabling writes for close at 1676145310789Writing region close event to WAL at 1676145310794 (+5 ms)Running coprocessor post-close hooks at 1676145310797 (+3 ms)Closed at 1676145310797 2023-02-11 19:55:10,797 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 43d4d223fc2e23c806b3e24d0b9e14e7 to self. 2023-02-11 19:55:10,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:55:10,799 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=43d4d223fc2e23c806b3e24d0b9e14e7, regionState=CLOSED 2023-02-11 19:55:10,799 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676145310799"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145310799"}]},"ts":"1676145310799"} 2023-02-11 19:55:10,801 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-02-11 19:55:10,801 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 43d4d223fc2e23c806b3e24d0b9e14e7, server=jenkins-hbase4.apache.org,45897,1676145215747 in 162 msec 2023-02-11 19:55:10,802 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=43d4d223fc2e23c806b3e24d0b9e14e7, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=true 2023-02-11 19:55:10,952 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=43d4d223fc2e23c806b3e24d0b9e14e7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:10,952 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676145310952"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145310952"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145310952"}]},"ts":"1676145310952"} 2023-02-11 19:55:10,954 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 43d4d223fc2e23c806b3e24d0b9e14e7, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:55:11,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:11,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 43d4d223fc2e23c806b3e24d0b9e14e7, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:55:11,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:55:11,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:55:11,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:55:11,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:55:11,109 INFO [StoreOpener-43d4d223fc2e23c806b3e24d0b9e14e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:55:11,110 DEBUG [StoreOpener-43d4d223fc2e23c806b3e24d0b9e14e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1 2023-02-11 19:55:11,110 DEBUG [StoreOpener-43d4d223fc2e23c806b3e24d0b9e14e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1 2023-02-11 19:55:11,110 INFO [StoreOpener-43d4d223fc2e23c806b3e24d0b9e14e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43d4d223fc2e23c806b3e24d0b9e14e7 columnFamilyName family1 2023-02-11 19:55:11,114 DEBUG [StoreOpener-43d4d223fc2e23c806b3e24d0b9e14e7-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/2558f752fcb34e31956e4c9cc59c9e89 2023-02-11 19:55:11,117 DEBUG [StoreOpener-43d4d223fc2e23c806b3e24d0b9e14e7-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/family1/9fb7b1f26aea4931ae90b83809ce323c_SeqId_53_ 2023-02-11 19:55:11,117 INFO [StoreOpener-43d4d223fc2e23c806b3e24d0b9e14e7-1] regionserver.HStore(310): Store=43d4d223fc2e23c806b3e24d0b9e14e7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:55:11,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:55:11,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:55:11,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:55:11,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 43d4d223fc2e23c806b3e24d0b9e14e7; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63751224, jitterRate=-0.050032734870910645}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:55:11,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 43d4d223fc2e23c806b3e24d0b9e14e7: Running coprocessor pre-open hook at 1676145311108Writing region info on filesystem at 1676145311108Initializing all the Stores at 1676145311109 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} at 1676145311109Cleaning up temporary data from old regions at 1676145311119 (+10 ms)Cleaning up detritus from prior splits at 1676145311119Running coprocessor post-open hooks at 1676145311122 (+3 ms)Region opened successfully at 1676145311122 2023-02-11 19:55:11,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7., pid=69, masterSystemTime=1676145311105 2023-02-11 19:55:11,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:11,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:55:11,124 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=43d4d223fc2e23c806b3e24d0b9e14e7, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:11,124 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676145311123"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145311123"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145311123"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145311123"}]},"ts":"1676145311123"} 2023-02-11 19:55:11,126 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-02-11 19:55:11,126 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 43d4d223fc2e23c806b3e24d0b9e14e7, server=jenkins-hbase4.apache.org,45897,1676145215747 in 171 msec 2023-02-11 19:55:11,127 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-02-11 19:55:11,127 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=43d4d223fc2e23c806b3e24d0b9e14e7, REOPEN/MOVE in 490 msec 2023-02-11 19:55:11,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-02-11 19:55:11,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 494 msec 2023-02-11 19:55:11,130 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 907 msec 2023-02-11 19:55:11,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-02-11 19:55:11,132 INFO [Listener at localhost/32929] compactions.TestMobCompactor(278): alter status finished 2023-02-11 19:55:11,133 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40445] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 19:55:11,134 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 19:55:11,135 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 19:55:11,135 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:55:11,135 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676145911135 2023-02-11 19:55:11,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 19:55:11,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-11 19:55:11,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 19:55:11,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] zookeeper.ReadOnlyZKClient(139): Connect 0x2d0d21b2 to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:55:11,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e4833a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:55:11,141 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:11,142 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:11,142 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:11,142 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:11,142 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:11,142 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:11,142 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:11,142 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 19:55:11,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 19:55:11,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:55:11,143 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 19:55:11,143 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 10 msec 2023-02-11 19:55:11,204 INFO [Listener at localhost/32929] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=238 (was 243), OpenFileDescriptor=609 (was 613), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=189 (was 243), ProcessCount=168 (was 168), AvailableMemoryMB=3565 (was 3610) 2023-02-11 19:55:11,215 INFO [Listener at localhost/32929] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=238, OpenFileDescriptor=609, MaxFileDescriptor=60000, SystemLoadAverage=189, ProcessCount=168, AvailableMemoryMB=3565 2023-02-11 19:55:11,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-11 19:55:11,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-02-11 19:55:11,219 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:55:11,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-02-11 19:55:11,220 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:55:11,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-11 19:55:11,221 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a 2023-02-11 19:55:11,222 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a empty. 2023-02-11 19:55:11,222 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a 2023-02-11 19:55:11,222 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-11 19:55:11,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-11 19:55:11,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-11 19:55:11,630 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-02-11 19:55:11,631 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5a19de8f167f17924a5ad29451409f2a, NAME => 'testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp 2023-02-11 19:55:11,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-11 19:55:12,039 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:55:12,039 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1603): Closing 5a19de8f167f17924a5ad29451409f2a, disabling compactions & flushes 2023-02-11 19:55:12,039 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a. 2023-02-11 19:55:12,039 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a. 2023-02-11 19:55:12,039 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a. after waiting 0 ms 2023-02-11 19:55:12,039 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a. 2023-02-11 19:55:12,039 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a. 2023-02-11 19:55:12,039 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1557): Region close journal for 5a19de8f167f17924a5ad29451409f2a: Waiting for close lock at 1676145312039Disabling compacts and flushes for region at 1676145312039Disabling writes for close at 1676145312039Writing region close event to WAL at 1676145312039Closed at 1676145312039 2023-02-11 19:55:12,041 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:55:12,042 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676145312042"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145312042"}]},"ts":"1676145312042"} 2023-02-11 19:55:12,043 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 19:55:12,044 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:55:12,044 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145312044"}]},"ts":"1676145312044"} 2023-02-11 19:55:12,045 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-02-11 19:55:12,047 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=5a19de8f167f17924a5ad29451409f2a, ASSIGN}] 2023-02-11 19:55:12,048 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=5a19de8f167f17924a5ad29451409f2a, ASSIGN 2023-02-11 19:55:12,049 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=5a19de8f167f17924a5ad29451409f2a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=false 2023-02-11 19:55:12,200 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=5a19de8f167f17924a5ad29451409f2a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:12,200 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676145312200"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145312200"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145312200"}]},"ts":"1676145312200"} 2023-02-11 19:55:12,201 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 5a19de8f167f17924a5ad29451409f2a, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:55:12,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-11 19:55:12,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a. 2023-02-11 19:55:12,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5a19de8f167f17924a5ad29451409f2a, NAME => 'testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:55:12,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-02-11 19:55:12,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-02-11 19:55:12,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 5a19de8f167f17924a5ad29451409f2a 2023-02-11 19:55:12,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:55:12,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5a19de8f167f17924a5ad29451409f2a 2023-02-11 19:55:12,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5a19de8f167f17924a5ad29451409f2a 2023-02-11 19:55:12,358 INFO [StoreOpener-5a19de8f167f17924a5ad29451409f2a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5a19de8f167f17924a5ad29451409f2a 2023-02-11 19:55:12,360 DEBUG [StoreOpener-5a19de8f167f17924a5ad29451409f2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1 2023-02-11 19:55:12,360 DEBUG [StoreOpener-5a19de8f167f17924a5ad29451409f2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1 2023-02-11 19:55:12,360 INFO [StoreOpener-5a19de8f167f17924a5ad29451409f2a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a19de8f167f17924a5ad29451409f2a columnFamilyName f1 2023-02-11 19:55:12,361 INFO [StoreOpener-5a19de8f167f17924a5ad29451409f2a-1] regionserver.HStore(310): Store=5a19de8f167f17924a5ad29451409f2a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:55:12,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a 2023-02-11 19:55:12,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a 2023-02-11 19:55:12,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5a19de8f167f17924a5ad29451409f2a 2023-02-11 19:55:12,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:55:12,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5a19de8f167f17924a5ad29451409f2a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63849747, jitterRate=-0.04856462776660919}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:55:12,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5a19de8f167f17924a5ad29451409f2a: Running coprocessor pre-open hook at 1676145312357Writing region info on filesystem at 1676145312357Initializing all the Stores at 1676145312358 (+1 ms)Instantiating store for column family {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145312358Cleaning up temporary data from old regions at 1676145312363 (+5 ms)Cleaning up detritus from prior splits at 1676145312363Running coprocessor post-open hooks at 1676145312366 (+3 ms)Region opened successfully at 1676145312366 2023-02-11 19:55:12,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a., pid=73, masterSystemTime=1676145312353 2023-02-11 19:55:12,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a. 2023-02-11 19:55:12,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a. 2023-02-11 19:55:12,368 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=5a19de8f167f17924a5ad29451409f2a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:12,368 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676145312368"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145312368"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145312368"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145312368"}]},"ts":"1676145312368"} 2023-02-11 19:55:12,371 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-02-11 19:55:12,371 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 5a19de8f167f17924a5ad29451409f2a, server=jenkins-hbase4.apache.org,45897,1676145215747 in 168 msec 2023-02-11 19:55:12,372 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-02-11 19:55:12,372 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=5a19de8f167f17924a5ad29451409f2a, ASSIGN in 324 msec 2023-02-11 19:55:12,373 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:55:12,373 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145312373"}]},"ts":"1676145312373"} 2023-02-11 19:55:12,374 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-02-11 19:55:12,375 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:55:12,376 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1580 sec 2023-02-11 19:55:13,300 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-02-11 19:55:13,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-11 19:55:13,324 INFO [Listener at localhost/32929] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-02-11 19:55:13,324 DEBUG [Listener at localhost/32929] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-02-11 19:55:13,326 INFO [Listener at localhost/32929] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 19:55:13,329 INFO [Listener at localhost/32929] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-02-11 19:55:13,329 INFO [Listener at localhost/32929] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 19:55:13,329 INFO [Listener at localhost/32929] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-02-11 19:55:13,333 INFO [Listener at localhost/32929] regionserver.HRegion(2744): Flushing 5a19de8f167f17924a5ad29451409f2a 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-11 19:55:13,746 INFO [Listener at localhost/32929] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021180bbf66f102743b1b94ea788912d1395 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021180bbf66f102743b1b94ea788912d1395 2023-02-11 19:55:14,151 INFO [Listener at localhost/32929] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/.tmp/f1/ab8b678f7e8e47499510627b23f4f237 2023-02-11 19:55:14,155 DEBUG [Listener at localhost/32929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/.tmp/f1/ab8b678f7e8e47499510627b23f4f237 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237 2023-02-11 19:55:14,159 INFO [Listener at localhost/32929] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237, entries=1, sequenceid=5, filesize=4.9 K 2023-02-11 19:55:14,160 INFO [Listener at localhost/32929] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 5a19de8f167f17924a5ad29451409f2a in 827ms, sequenceid=5, compaction requested=false 2023-02-11 19:55:14,161 DEBUG [Listener at localhost/32929] regionserver.HRegion(2445): Flush status journal for 5a19de8f167f17924a5ad29451409f2a: 2023-02-11 19:55:14,162 INFO [Listener at localhost/32929] regionserver.HRegion(2744): Flushing 5a19de8f167f17924a5ad29451409f2a 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-11 19:55:14,452 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 19:55:14,573 INFO [Listener at localhost/32929] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211c9099685d0d04523a0807643d861c822 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230211c9099685d0d04523a0807643d861c822 2023-02-11 19:55:14,783 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-11 19:55:14,783 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-02-11 19:55:14,978 INFO [Listener at localhost/32929] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/.tmp/f1/a0c45ba3d65f468398c969fc843f1445 2023-02-11 19:55:14,982 DEBUG [Listener at localhost/32929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/.tmp/f1/a0c45ba3d65f468398c969fc843f1445 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445 2023-02-11 19:55:14,985 INFO [Listener at localhost/32929] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445, entries=1, sequenceid=9, filesize=4.9 K 2023-02-11 19:55:14,986 INFO [Listener at localhost/32929] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 5a19de8f167f17924a5ad29451409f2a in 824ms, sequenceid=9, compaction requested=false 2023-02-11 19:55:14,986 DEBUG [Listener at localhost/32929] regionserver.HRegion(2445): Flush status journal for 5a19de8f167f17924a5ad29451409f2a: 2023-02-11 19:55:14,988 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40445] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-02-11 19:55:14,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-11 19:55:14,989 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-11 19:55:14,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:55:14,990 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676145914990 2023-02-11 19:55:14,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-11 19:55:14,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-02-11 19:55:14,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-02-11 19:55:14,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] zookeeper.ReadOnlyZKClient(139): Connect 0x47aed2db to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:55:14,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78c42cbd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:55:14,997 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230211 for table='testGetAfterCompaction' and column='f1' 2023-02-11 19:55:15,039 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,039 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,090 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,090 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,141 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,141 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,191 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,192 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,242 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,242 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,293 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,293 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,344 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,344 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,394 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,394 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,445 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,445 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,496 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,496 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,547 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,547 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,597 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,597 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,648 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,648 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,699 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,699 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,749 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,749 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,800 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,800 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,820 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211599699d34cfe4a2b82806c1324695359 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230211599699d34cfe4a2b82806c1324695359 2023-02-11 19:55:15,820 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testGetAfterCompaction' column='f1' 2023-02-11 19:55:15,833 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:55:15,834 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38736, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:55:15,839 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:55:15,841 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41100, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:55:15,848 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/f1/3247268497a04f8d82db321e43a2e7ae first=Optional[r1] last=Optional[r2] 2023-02-11 19:55:15,849 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row with hfile group [{f1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/f1/3247268497a04f8d82db321e43a2e7ae}] 2023-02-11 19:55:15,851 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,851 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/f1/3247268497a04f8d82db321e43a2e7ae for inclusion in 5a19de8f167f17924a5ad29451409f2a/f1 2023-02-11 19:55:15,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-11 19:55:15,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 19:55:15,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 5a19de8f167f17924a5ad29451409f2a: 2023-02-11 19:55:15,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/f1/3247268497a04f8d82db321e43a2e7ae to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testGetAfterCompaction__tal0k06v4kvsbankshfvigcp2p5ej0sqf3a0k56ghftvadb8nalcj5u92h142497/f1/3247268497a04f8d82db321e43a2e7ae 2023-02-11 19:55:15,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testGetAfterCompaction__tal0k06v4kvsbankshfvigcp2p5ej0sqf3a0k56ghftvadb8nalcj5u92h142497/f1/3247268497a04f8d82db321e43a2e7ae as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_ 2023-02-11 19:55:15,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testGetAfterCompaction__tal0k06v4kvsbankshfvigcp2p5ej0sqf3a0k56ghftvadb8nalcj5u92h142497/f1/3247268497a04f8d82db321e43a2e7ae into 5a19de8f167f17924a5ad29451409f2a/f1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_ - updating store file list. 2023-02-11 19:55:15,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_ into 5a19de8f167f17924a5ad29451409f2a/f1 2023-02-11 19:55:15,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testGetAfterCompaction__tal0k06v4kvsbankshfvigcp2p5ej0sqf3a0k56ghftvadb8nalcj5u92h142497/f1/3247268497a04f8d82db321e43a2e7ae into 5a19de8f167f17924a5ad29451409f2a/f1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_) 2023-02-11 19:55:15,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testGetAfterCompaction__tal0k06v4kvsbankshfvigcp2p5ej0sqf3a0k56ghftvadb8nalcj5u92h142497/f1/3247268497a04f8d82db321e43a2e7ae 2023-02-11 19:55:15,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(1912): 5a19de8f167f17924a5ad29451409f2a/f1 is initiating minor compaction 2023-02-11 19:55:15,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1c988d15; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:55:15,862 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 5a19de8f167f17924a5ad29451409f2a/f1 in testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a. 2023-02-11 19:55:15,862 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/.tmp, totalSize=10.0 K 2023-02-11 19:55:15,862 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting a0c45ba3d65f468398c969fc843f1445, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 19:55:15,862 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 19:55:15,864 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testGetAfterCompaction' column='f1' 2023-02-11 19:55:15,865 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:15,866 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021180bbf66f102743b1b94ea788912d1395 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021180bbf66f102743b1b94ea788912d1395 2023-02-11 19:55:15,867 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230211c9099685d0d04523a0807643d861c822 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230211c9099685d0d04523a0807643d861c822 2023-02-11 19:55:15,867 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-02-11 19:55:15,867 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230211' 2023-02-11 19:55:15,867 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230211 for table='testGetAfterCompaction' and column='f1' 2023-02-11 19:55:15,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-02-11 19:55:15,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:55:15,868 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-11 19:55:15,870 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 880 msec 2023-02-11 19:55:15,871 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5a19de8f167f17924a5ad29451409f2a#f1#compaction#77 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-02-11 19:55:15,902 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676145315816; access_time=1676145315007; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 19:55:15,902 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,902 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,905 DEBUG [Listener at localhost/32929] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 19:55:15,909 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38738, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 19:55:15,909 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45897] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a. 2023-02-11 19:55:15,910 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45897] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-02-11 19:55:15,910 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45897] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-11 19:55:15,910 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45897] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-11 19:55:15,910 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45897] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a. because compaction request was cancelled 2023-02-11 19:55:15,961 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676145315816; access_time=1676145315007; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 19:55:15,961 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:15,961 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,012 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676145315816; access_time=1676145315007; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 19:55:16,012 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,012 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,063 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676145315816; access_time=1676145315007; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 19:55:16,063 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,063 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,114 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676145315816; access_time=1676145315007; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 19:55:16,114 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,114 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,164 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676145315816; access_time=1676145315007; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 19:55:16,164 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,164 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,215 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676145315816; access_time=1676145315007; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 19:55:16,215 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,215 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,266 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676145315816; access_time=1676145315007; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 19:55:16,266 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,266 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,316 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676145315816; access_time=1676145315007; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 19:55:16,317 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,317 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,367 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676145315816; access_time=1676145315007; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 19:55:16,367 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,367 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,418 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676145315816; access_time=1676145315007; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 19:55:16,418 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,418 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,469 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676145315816; access_time=1676145315007; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 19:55:16,469 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,469 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,520 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676145315816; access_time=1676145315007; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 19:55:16,520 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,520 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,570 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676145315816; access_time=1676145315007; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 19:55:16,571 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,571 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,621 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676145315816; access_time=1676145315007; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 19:55:16,621 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,621 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,672 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676145315816; access_time=1676145315007; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 19:55:16,672 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,672 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,684 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/.tmp/f1/10542f492bc344f4bf4a08082394de0e as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/10542f492bc344f4bf4a08082394de0e 2023-02-11 19:55:16,688 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 5a19de8f167f17924a5ad29451409f2a/f1 of 5a19de8f167f17924a5ad29451409f2a into 10542f492bc344f4bf4a08082394de0e(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 19:55:16,688 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 5a19de8f167f17924a5ad29451409f2a: 2023-02-11 19:55:16,689 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1676145315861; duration=0sec 2023-02-11 19:55:16,689 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:55:16,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_] to archive 2023-02-11 19:55:16,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:16,723 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/10542f492bc344f4bf4a08082394de0e; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1676145316679; access_time=1676145315869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,723 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676145315816; access_time=1676145315007; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 19:55:16,723 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314977; access_time=1676145314164; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,723 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/a0c45ba3d65f468398c969fc843f1445 2023-02-11 19:55:16,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_ to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/59cd90a8a8be48aa9d577c12c2c29d95_SeqId_12_ 2023-02-11 19:55:16,774 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/10542f492bc344f4bf4a08082394de0e; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1676145316679; access_time=1676145315869; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,774 INFO [Listener at localhost/32929] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676145314150; access_time=1676145313337; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 19:55:16,896 INFO [Listener at localhost/32929] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-02-11 19:55:16,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-02-11 19:55:16,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-02-11 19:55:16,908 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145316908"}]},"ts":"1676145316908"} 2023-02-11 19:55:16,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-11 19:55:16,909 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-02-11 19:55:16,915 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-02-11 19:55:16,916 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=5a19de8f167f17924a5ad29451409f2a, UNASSIGN}] 2023-02-11 19:55:16,918 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=5a19de8f167f17924a5ad29451409f2a, UNASSIGN 2023-02-11 19:55:16,918 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=5a19de8f167f17924a5ad29451409f2a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:16,918 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676145316918"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145316918"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145316918"}]},"ts":"1676145316918"} 2023-02-11 19:55:16,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 5a19de8f167f17924a5ad29451409f2a, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:55:17,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-11 19:55:17,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5a19de8f167f17924a5ad29451409f2a 2023-02-11 19:55:17,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5a19de8f167f17924a5ad29451409f2a, disabling compactions & flushes 2023-02-11 19:55:17,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a. 2023-02-11 19:55:17,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a. 2023-02-11 19:55:17,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a. after waiting 0 ms 2023-02-11 19:55:17,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a. 2023-02-11 19:55:17,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-11 19:55:17,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-11 19:55:17,077 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a. 2023-02-11 19:55:17,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5a19de8f167f17924a5ad29451409f2a: Waiting for close lock at 1676145317071Running coprocessor pre-close hooks at 1676145317071Disabling compacts and flushes for region at 1676145317071Disabling writes for close at 1676145317071Writing region close event to WAL at 1676145317072 (+1 ms)Running coprocessor post-close hooks at 1676145317076 (+4 ms)Closed at 1676145317077 (+1 ms) 2023-02-11 19:55:17,078 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5a19de8f167f17924a5ad29451409f2a 2023-02-11 19:55:17,079 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=5a19de8f167f17924a5ad29451409f2a, regionState=CLOSED 2023-02-11 19:55:17,079 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676145317079"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145317079"}]},"ts":"1676145317079"} 2023-02-11 19:55:17,081 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-02-11 19:55:17,081 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 5a19de8f167f17924a5ad29451409f2a, server=jenkins-hbase4.apache.org,45897,1676145215747 in 161 msec 2023-02-11 19:55:17,082 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-02-11 19:55:17,082 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=5a19de8f167f17924a5ad29451409f2a, UNASSIGN in 165 msec 2023-02-11 19:55:17,082 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145317082"}]},"ts":"1676145317082"} 2023-02-11 19:55:17,083 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-02-11 19:55:17,084 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-02-11 19:55:17,086 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 184 msec 2023-02-11 19:55:17,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-11 19:55:17,211 INFO [Listener at localhost/32929] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-02-11 19:55:17,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-02-11 19:55:17,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-02-11 19:55:17,223 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-11 19:55:17,224 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-11 19:55:17,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-11 19:55:17,226 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a 2023-02-11 19:55:17,229 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1, FileablePath, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/recovered.edits] 2023-02-11 19:55:17,231 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/10542f492bc344f4bf4a08082394de0e to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/10542f492bc344f4bf4a08082394de0e 2023-02-11 19:55:17,232 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/f1/ab8b678f7e8e47499510627b23f4f237 2023-02-11 19:55:17,234 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/recovered.edits/15.seqid to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a/recovered.edits/15.seqid 2023-02-11 19:55:17,234 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testGetAfterCompaction/5a19de8f167f17924a5ad29451409f2a 2023-02-11 19:55:17,234 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-11 19:55:17,235 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-11 19:55:17,235 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-02-11 19:55:17,237 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230211599699d34cfe4a2b82806c1324695359 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230211599699d34cfe4a2b82806c1324695359 2023-02-11 19:55:17,238 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-11 19:55:17,239 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-11 19:55:17,259 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-02-11 19:55:17,261 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-02-11 19:55:17,262 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-11 19:55:17,262 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-02-11 19:55:17,262 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676145317262"}]},"ts":"9223372036854775807"} 2023-02-11 19:55:17,263 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-11 19:55:17,263 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5a19de8f167f17924a5ad29451409f2a, NAME => 'testGetAfterCompaction,,1676145311217.5a19de8f167f17924a5ad29451409f2a.', STARTKEY => '', ENDKEY => ''}] 2023-02-11 19:55:17,263 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-02-11 19:55:17,264 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676145317264"}]},"ts":"9223372036854775807"} 2023-02-11 19:55:17,265 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-02-11 19:55:17,267 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-11 19:55:17,268 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 50 msec 2023-02-11 19:55:17,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-11 19:55:17,326 INFO [Listener at localhost/32929] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-02-11 19:55:17,339 INFO [Listener at localhost/32929] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=242 (was 238) - Thread LEAK? -, OpenFileDescriptor=608 (was 609), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=184 (was 189), ProcessCount=168 (was 168), AvailableMemoryMB=3564 (was 3565) 2023-02-11 19:55:17,349 INFO [Listener at localhost/32929] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=242, OpenFileDescriptor=608, MaxFileDescriptor=60000, SystemLoadAverage=184, ProcessCount=168, AvailableMemoryMB=3564 2023-02-11 19:55:17,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-11 19:55:17,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-02-11 19:55:17,353 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:55:17,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-02-11 19:55:17,353 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:55:17,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-11 19:55:17,355 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454 2023-02-11 19:55:17,355 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c 2023-02-11 19:55:17,355 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5 2023-02-11 19:55:17,356 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454 empty. 2023-02-11 19:55:17,356 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5 empty. 2023-02-11 19:55:17,356 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c empty. 2023-02-11 19:55:17,356 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454 2023-02-11 19:55:17,356 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c 2023-02-11 19:55:17,356 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5 2023-02-11 19:55:17,356 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-02-11 19:55:17,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-11 19:55:17,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-11 19:55:17,763 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-11 19:55:17,765 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7671): creating {ENCODED => 42f2c6a1e29ae18303d02e7977b355c5, NAME => 'testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp 2023-02-11 19:55:17,765 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7671): creating {ENCODED => 41e9cd5e0c2aceca461c1cf15a182b3c, NAME => 'testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp 2023-02-11 19:55:17,765 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0086a9a022be72d7afa868235730b454, NAME => 'testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp 2023-02-11 19:55:17,777 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:55:17,778 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1603): Closing 41e9cd5e0c2aceca461c1cf15a182b3c, disabling compactions & flushes 2023-02-11 19:55:17,778 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:17,778 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:17,778 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. after waiting 0 ms 2023-02-11 19:55:17,778 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:17,778 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:17,778 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1557): Region close journal for 41e9cd5e0c2aceca461c1cf15a182b3c: Waiting for close lock at 1676145317778Disabling compacts and flushes for region at 1676145317778Disabling writes for close at 1676145317778Writing region close event to WAL at 1676145317778Closed at 1676145317778 2023-02-11 19:55:17,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-11 19:55:18,177 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:55:18,177 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1603): Closing 42f2c6a1e29ae18303d02e7977b355c5, disabling compactions & flushes 2023-02-11 19:55:18,177 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:18,177 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:18,177 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. after waiting 0 ms 2023-02-11 19:55:18,177 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:18,177 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:18,177 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1557): Region close journal for 42f2c6a1e29ae18303d02e7977b355c5: Waiting for close lock at 1676145318177Disabling compacts and flushes for region at 1676145318177Disabling writes for close at 1676145318177Writing region close event to WAL at 1676145318177Closed at 1676145318177 2023-02-11 19:55:18,178 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:55:18,178 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1603): Closing 0086a9a022be72d7afa868235730b454, disabling compactions & flushes 2023-02-11 19:55:18,178 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:18,178 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:18,178 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. after waiting 0 ms 2023-02-11 19:55:18,178 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:18,178 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:18,178 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1557): Region close journal for 0086a9a022be72d7afa868235730b454: Waiting for close lock at 1676145318178Disabling compacts and flushes for region at 1676145318178Disabling writes for close at 1676145318178Writing region close event to WAL at 1676145318178Closed at 1676145318178 2023-02-11 19:55:18,180 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:55:18,181 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676145318181"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145318181"}]},"ts":"1676145318181"} 2023-02-11 19:55:18,181 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676145318181"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145318181"}]},"ts":"1676145318181"} 2023-02-11 19:55:18,181 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676145318181"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145318181"}]},"ts":"1676145318181"} 2023-02-11 19:55:18,183 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-11 19:55:18,184 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:55:18,184 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145318184"}]},"ts":"1676145318184"} 2023-02-11 19:55:18,185 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-11 19:55:18,190 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0086a9a022be72d7afa868235730b454, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=41e9cd5e0c2aceca461c1cf15a182b3c, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=42f2c6a1e29ae18303d02e7977b355c5, ASSIGN}] 2023-02-11 19:55:18,192 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0086a9a022be72d7afa868235730b454, ASSIGN 2023-02-11 19:55:18,192 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=42f2c6a1e29ae18303d02e7977b355c5, ASSIGN 2023-02-11 19:55:18,192 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=41e9cd5e0c2aceca461c1cf15a182b3c, ASSIGN 2023-02-11 19:55:18,192 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0086a9a022be72d7afa868235730b454, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=false 2023-02-11 19:55:18,192 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=41e9cd5e0c2aceca461c1cf15a182b3c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=false 2023-02-11 19:55:18,192 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=42f2c6a1e29ae18303d02e7977b355c5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=false 2023-02-11 19:55:18,344 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=0086a9a022be72d7afa868235730b454, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:18,344 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=41e9cd5e0c2aceca461c1cf15a182b3c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:18,344 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=42f2c6a1e29ae18303d02e7977b355c5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:18,344 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676145318344"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145318344"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145318344"}]},"ts":"1676145318344"} 2023-02-11 19:55:18,344 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676145318344"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145318344"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145318344"}]},"ts":"1676145318344"} 2023-02-11 19:55:18,344 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676145318344"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145318344"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145318344"}]},"ts":"1676145318344"} 2023-02-11 19:55:18,345 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure 0086a9a022be72d7afa868235730b454, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:55:18,346 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=81, state=RUNNABLE; OpenRegionProcedure 41e9cd5e0c2aceca461c1cf15a182b3c, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:55:18,347 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE; OpenRegionProcedure 42f2c6a1e29ae18303d02e7977b355c5, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:55:18,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-11 19:55:18,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:18,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 42f2c6a1e29ae18303d02e7977b355c5, NAME => 'testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5.', STARTKEY => '2', ENDKEY => ''} 2023-02-11 19:55:18,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 42f2c6a1e29ae18303d02e7977b355c5 2023-02-11 19:55:18,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:55:18,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 42f2c6a1e29ae18303d02e7977b355c5 2023-02-11 19:55:18,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 42f2c6a1e29ae18303d02e7977b355c5 2023-02-11 19:55:18,502 INFO [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 42f2c6a1e29ae18303d02e7977b355c5 2023-02-11 19:55:18,503 DEBUG [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1 2023-02-11 19:55:18,504 DEBUG [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1 2023-02-11 19:55:18,504 INFO [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 42f2c6a1e29ae18303d02e7977b355c5 columnFamilyName family1 2023-02-11 19:55:18,505 INFO [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] regionserver.HStore(310): Store=42f2c6a1e29ae18303d02e7977b355c5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:55:18,505 INFO [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 42f2c6a1e29ae18303d02e7977b355c5 2023-02-11 19:55:18,507 DEBUG [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2 2023-02-11 19:55:18,507 DEBUG [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2 2023-02-11 19:55:18,507 INFO [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 42f2c6a1e29ae18303d02e7977b355c5 columnFamilyName family2 2023-02-11 19:55:18,508 INFO [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] regionserver.HStore(310): Store=42f2c6a1e29ae18303d02e7977b355c5/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:55:18,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5 2023-02-11 19:55:18,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5 2023-02-11 19:55:18,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:55:18,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 42f2c6a1e29ae18303d02e7977b355c5 2023-02-11 19:55:18,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:55:18,515 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 42f2c6a1e29ae18303d02e7977b355c5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68528719, jitterRate=0.021157488226890564}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:55:18,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 42f2c6a1e29ae18303d02e7977b355c5: Running coprocessor pre-open hook at 1676145318501Writing region info on filesystem at 1676145318501Initializing all the Stores at 1676145318502 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145318502Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145318502Cleaning up temporary data from old regions at 1676145318510 (+8 ms)Cleaning up detritus from prior splits at 1676145318510Running coprocessor post-open hooks at 1676145318515 (+5 ms)Region opened successfully at 1676145318515 2023-02-11 19:55:18,515 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5., pid=85, masterSystemTime=1676145318498 2023-02-11 19:55:18,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:18,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:18,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:18,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 41e9cd5e0c2aceca461c1cf15a182b3c, NAME => 'testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c.', STARTKEY => '1', ENDKEY => '2'} 2023-02-11 19:55:18,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 41e9cd5e0c2aceca461c1cf15a182b3c 2023-02-11 19:55:18,517 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=42f2c6a1e29ae18303d02e7977b355c5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:18,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:55:18,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 41e9cd5e0c2aceca461c1cf15a182b3c 2023-02-11 19:55:18,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 41e9cd5e0c2aceca461c1cf15a182b3c 2023-02-11 19:55:18,517 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676145318517"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145318517"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145318517"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145318517"}]},"ts":"1676145318517"} 2023-02-11 19:55:18,518 INFO [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 41e9cd5e0c2aceca461c1cf15a182b3c 2023-02-11 19:55:18,519 DEBUG [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1 2023-02-11 19:55:18,519 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=82 2023-02-11 19:55:18,519 DEBUG [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1 2023-02-11 19:55:18,519 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=82, state=SUCCESS; OpenRegionProcedure 42f2c6a1e29ae18303d02e7977b355c5, server=jenkins-hbase4.apache.org,45897,1676145215747 in 172 msec 2023-02-11 19:55:18,520 INFO [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41e9cd5e0c2aceca461c1cf15a182b3c columnFamilyName family1 2023-02-11 19:55:18,520 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=42f2c6a1e29ae18303d02e7977b355c5, ASSIGN in 329 msec 2023-02-11 19:55:18,520 INFO [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] regionserver.HStore(310): Store=41e9cd5e0c2aceca461c1cf15a182b3c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:55:18,521 INFO [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 41e9cd5e0c2aceca461c1cf15a182b3c 2023-02-11 19:55:18,522 DEBUG [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2 2023-02-11 19:55:18,522 DEBUG [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2 2023-02-11 19:55:18,522 INFO [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41e9cd5e0c2aceca461c1cf15a182b3c columnFamilyName family2 2023-02-11 19:55:18,523 INFO [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] regionserver.HStore(310): Store=41e9cd5e0c2aceca461c1cf15a182b3c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:55:18,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c 2023-02-11 19:55:18,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c 2023-02-11 19:55:18,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:55:18,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 41e9cd5e0c2aceca461c1cf15a182b3c 2023-02-11 19:55:18,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:55:18,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 41e9cd5e0c2aceca461c1cf15a182b3c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63989321, jitterRate=-0.0464848130941391}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:55:18,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 41e9cd5e0c2aceca461c1cf15a182b3c: Running coprocessor pre-open hook at 1676145318517Writing region info on filesystem at 1676145318517Initializing all the Stores at 1676145318518 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145318518Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145318518Cleaning up temporary data from old regions at 1676145318524 (+6 ms)Cleaning up detritus from prior splits at 1676145318524Running coprocessor post-open hooks at 1676145318528 (+4 ms)Region opened successfully at 1676145318528 2023-02-11 19:55:18,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c., pid=84, masterSystemTime=1676145318498 2023-02-11 19:55:18,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:18,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:18,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:18,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0086a9a022be72d7afa868235730b454, NAME => 'testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454.', STARTKEY => '', ENDKEY => '1'} 2023-02-11 19:55:18,530 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=41e9cd5e0c2aceca461c1cf15a182b3c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:18,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 0086a9a022be72d7afa868235730b454 2023-02-11 19:55:18,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:55:18,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0086a9a022be72d7afa868235730b454 2023-02-11 19:55:18,530 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676145318530"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145318530"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145318530"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145318530"}]},"ts":"1676145318530"} 2023-02-11 19:55:18,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0086a9a022be72d7afa868235730b454 2023-02-11 19:55:18,531 INFO [StoreOpener-0086a9a022be72d7afa868235730b454-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0086a9a022be72d7afa868235730b454 2023-02-11 19:55:18,532 DEBUG [StoreOpener-0086a9a022be72d7afa868235730b454-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1 2023-02-11 19:55:18,532 DEBUG [StoreOpener-0086a9a022be72d7afa868235730b454-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1 2023-02-11 19:55:18,532 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=81 2023-02-11 19:55:18,532 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=81, state=SUCCESS; OpenRegionProcedure 41e9cd5e0c2aceca461c1cf15a182b3c, server=jenkins-hbase4.apache.org,45897,1676145215747 in 185 msec 2023-02-11 19:55:18,533 INFO [StoreOpener-0086a9a022be72d7afa868235730b454-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0086a9a022be72d7afa868235730b454 columnFamilyName family1 2023-02-11 19:55:18,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=41e9cd5e0c2aceca461c1cf15a182b3c, ASSIGN in 343 msec 2023-02-11 19:55:18,534 INFO [StoreOpener-0086a9a022be72d7afa868235730b454-1] regionserver.HStore(310): Store=0086a9a022be72d7afa868235730b454/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:55:18,534 INFO [StoreOpener-0086a9a022be72d7afa868235730b454-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0086a9a022be72d7afa868235730b454 2023-02-11 19:55:18,535 DEBUG [StoreOpener-0086a9a022be72d7afa868235730b454-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2 2023-02-11 19:55:18,535 DEBUG [StoreOpener-0086a9a022be72d7afa868235730b454-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2 2023-02-11 19:55:18,535 INFO [StoreOpener-0086a9a022be72d7afa868235730b454-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0086a9a022be72d7afa868235730b454 columnFamilyName family2 2023-02-11 19:55:18,536 INFO [StoreOpener-0086a9a022be72d7afa868235730b454-1] regionserver.HStore(310): Store=0086a9a022be72d7afa868235730b454/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:55:18,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454 2023-02-11 19:55:18,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454 2023-02-11 19:55:18,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:55:18,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0086a9a022be72d7afa868235730b454 2023-02-11 19:55:18,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:55:18,541 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0086a9a022be72d7afa868235730b454; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75017595, jitterRate=0.11784927546977997}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:55:18,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0086a9a022be72d7afa868235730b454: Running coprocessor pre-open hook at 1676145318530Writing region info on filesystem at 1676145318530Initializing all the Stores at 1676145318531 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145318531Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145318531Cleaning up temporary data from old regions at 1676145318538 (+7 ms)Cleaning up detritus from prior splits at 1676145318538Running coprocessor post-open hooks at 1676145318541 (+3 ms)Region opened successfully at 1676145318541 2023-02-11 19:55:18,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454., pid=83, masterSystemTime=1676145318498 2023-02-11 19:55:18,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:18,543 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:18,543 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=0086a9a022be72d7afa868235730b454, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:18,543 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676145318543"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145318543"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145318543"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145318543"}]},"ts":"1676145318543"} 2023-02-11 19:55:18,545 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=80 2023-02-11 19:55:18,545 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure 0086a9a022be72d7afa868235730b454, server=jenkins-hbase4.apache.org,45897,1676145215747 in 199 msec 2023-02-11 19:55:18,546 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=80, resume processing ppid=79 2023-02-11 19:55:18,547 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0086a9a022be72d7afa868235730b454, ASSIGN in 356 msec 2023-02-11 19:55:18,547 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:55:18,547 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145318547"}]},"ts":"1676145318547"} 2023-02-11 19:55:18,548 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-11 19:55:18,550 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:55:18,551 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.1990 sec 2023-02-11 19:55:19,301 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-11 19:55:19,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-11 19:55:19,458 INFO [Listener at localhost/32929] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-02-11 19:55:19,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:19,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:19,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:19,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:55:19,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-11 19:55:19,471 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-11 19:55:19,471 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:19,471 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-11 19:55:19,471 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-11 19:55:19,472 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:19,472 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:19,473 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:19,473 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:19,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:19,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:19,473 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:19,473 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:55:19,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:19,474 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:19,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:55:19,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:19,474 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-11 19:55:19,474 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-11 19:55:19,474 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-11 19:55:19,474 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:19,474 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-11 19:55:19,475 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:19,475 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. started... 2023-02-11 19:55:19,475 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 19:55:19,475 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:19,475 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 42f2c6a1e29ae18303d02e7977b355c5 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 19:55:19,475 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:19,475 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. started... 2023-02-11 19:55:19,475 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:55:19,476 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. started... 2023-02-11 19:55:19,476 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 41e9cd5e0c2aceca461c1cf15a182b3c 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 19:55:19,477 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0086a9a022be72d7afa868235730b454 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 19:55:19,896 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302116efc758a310747efacf0581ad538aff3 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302116efc758a310747efacf0581ad538aff3 2023-02-11 19:55:19,896 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302111bd25a41a8d742bcbc6215d6214e492e to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302111bd25a41a8d742bcbc6215d6214e492e 2023-02-11 19:55:19,898 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211f5280f8bfa5e498b9fa4d88fa42c0790 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211f5280f8bfa5e498b9fa4d88fa42c0790 2023-02-11 19:55:19,908 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family1/79aa122c58d142cdbb2e5673a05d98f5 2023-02-11 19:55:19,909 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family1/0043e881679c4aafb4daf958eaca931b 2023-02-11 19:55:20,303 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family1/62dedfe0ab4243159cc965af16601edc 2023-02-11 19:55:20,323 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211b0c8a4d24dcb4569a6268d1638945892 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211b0c8a4d24dcb4569a6268d1638945892 2023-02-11 19:55:20,323 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302110521519962064bcaae6dfc38448f8981 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302110521519962064bcaae6dfc38448f8981 2023-02-11 19:55:20,717 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211197593bd71dc46bdb87b936d2dd523d9 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211197593bd71dc46bdb87b936d2dd523d9 2023-02-11 19:55:20,727 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family2/b9364ca0030f4bfe9f7a345dc3efb560 2023-02-11 19:55:20,727 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family2/10dfe7d4feb94f329cd6f96056c69c63 2023-02-11 19:55:20,731 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family1/79aa122c58d142cdbb2e5673a05d98f5 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/79aa122c58d142cdbb2e5673a05d98f5 2023-02-11 19:55:20,731 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family1/0043e881679c4aafb4daf958eaca931b as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/0043e881679c4aafb4daf958eaca931b 2023-02-11 19:55:20,734 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/79aa122c58d142cdbb2e5673a05d98f5, entries=4, sequenceid=5, filesize=5.4 K 2023-02-11 19:55:20,735 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/0043e881679c4aafb4daf958eaca931b, entries=4, sequenceid=5, filesize=5.4 K 2023-02-11 19:55:20,735 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family2/b9364ca0030f4bfe9f7a345dc3efb560 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/b9364ca0030f4bfe9f7a345dc3efb560 2023-02-11 19:55:20,736 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family2/10dfe7d4feb94f329cd6f96056c69c63 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/10dfe7d4feb94f329cd6f96056c69c63 2023-02-11 19:55:20,739 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/b9364ca0030f4bfe9f7a345dc3efb560, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 19:55:20,739 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/10dfe7d4feb94f329cd6f96056c69c63, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 19:55:20,740 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 42f2c6a1e29ae18303d02e7977b355c5 in 1264ms, sequenceid=5, compaction requested=false 2023-02-11 19:55:20,740 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 42f2c6a1e29ae18303d02e7977b355c5: 2023-02-11 19:55:20,740 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:20,740 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 19:55:20,741 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 0086a9a022be72d7afa868235730b454 in 1263ms, sequenceid=5, compaction requested=false 2023-02-11 19:55:20,741 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0086a9a022be72d7afa868235730b454: 2023-02-11 19:55:20,741 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:20,741 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 19:55:21,122 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family2/97eef38102724ed2b51e73049cb17d47 2023-02-11 19:55:21,127 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family1/62dedfe0ab4243159cc965af16601edc as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/62dedfe0ab4243159cc965af16601edc 2023-02-11 19:55:21,130 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/62dedfe0ab4243159cc965af16601edc, entries=4, sequenceid=5, filesize=5.4 K 2023-02-11 19:55:21,130 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family2/97eef38102724ed2b51e73049cb17d47 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/97eef38102724ed2b51e73049cb17d47 2023-02-11 19:55:21,134 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/97eef38102724ed2b51e73049cb17d47, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 19:55:21,135 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 41e9cd5e0c2aceca461c1cf15a182b3c in 1659ms, sequenceid=5, compaction requested=false 2023-02-11 19:55:21,135 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 41e9cd5e0c2aceca461c1cf15a182b3c: 2023-02-11 19:55:21,135 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:21,135 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 19:55:21,135 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 19:55:21,135 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:21,135 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-11 19:55:21,135 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-11 19:55:21,136 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:21,136 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:21,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:21,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:21,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:21,137 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:21,137 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:55:21,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:21,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:21,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:21,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:21,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:21,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-11 19:55:21,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4abc2ec2[Count = 0] remaining members to acquire global barrier 2023-02-11 19:55:21,138 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-11 19:55:21,138 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:21,140 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:21,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:21,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:21,140 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-11 19:55:21,141 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-11 19:55:21,141 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:55:21,141 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:21,141 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:55:21,142 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:21,142 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-11 19:55:21,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:21,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:21,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:21,142 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:21,142 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-11 19:55:21,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:21,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:21,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:21,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:21,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:21,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:21,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:21,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:55:21,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-11 19:55:21,144 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-11 19:55:21,144 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:55:21,144 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:55:21,144 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-11 19:55:21,144 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:55:21,145 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:21,145 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:21,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:21,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:21,145 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:21,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:21,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:21,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:21,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:21,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:21,146 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:21,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:21,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:21,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:21,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:21,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:21,147 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:21,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:21,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:21,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:21,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:21,148 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:21,148 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:21,148 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:21,148 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:21,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-11 19:55:21,148 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:21,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-11 19:55:21,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:55:21,148 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:21,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:21,149 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:21,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:21,149 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:21,149 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-11 19:55:21,149 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:21,149 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:55:21,149 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:21,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:21,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:21,249 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:55:21,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:55:21,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:21,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:21,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:21,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:55:21,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-11 19:55:21,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-11 19:55:21,258 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-11 19:55:21,258 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:21,259 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-11 19:55:21,259 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-11 19:55:21,259 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:21,259 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:21,261 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:21,261 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:21,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:21,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:21,262 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:21,262 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:55:21,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:21,262 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:21,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:55:21,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:21,262 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-11 19:55:21,263 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-11 19:55:21,263 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-11 19:55:21,263 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-11 19:55:21,263 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:21,263 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-11 19:55:21,263 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:21,263 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. started... 2023-02-11 19:55:21,263 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 19:55:21,263 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:21,263 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:55:21,264 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 42f2c6a1e29ae18303d02e7977b355c5 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 19:55:21,263 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:21,264 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. started... 2023-02-11 19:55:21,264 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. started... 2023-02-11 19:55:21,264 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 41e9cd5e0c2aceca461c1cf15a182b3c 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 19:55:21,264 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0086a9a022be72d7afa868235730b454 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 19:55:21,686 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021110b4444813bd45d3a803e3041d64b560 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021110b4444813bd45d3a803e3041d64b560 2023-02-11 19:55:21,686 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302111cf551d1e927405d8ca52c8c3eaac980 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302111cf551d1e927405d8ca52c8c3eaac980 2023-02-11 19:55:21,686 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302114a43cb1a719b43a4a8cf8695d755a199 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302114a43cb1a719b43a4a8cf8695d755a199 2023-02-11 19:55:21,692 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family1/616ddda77da84c3a837506544b7cb109 2023-02-11 19:55:21,707 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211422794b6235048f99246437e13f22796 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211422794b6235048f99246437e13f22796 2023-02-11 19:55:22,092 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family1/8c27cc08c9ab4d6d9e67df97f16c94a5 2023-02-11 19:55:22,093 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family1/df7b960c05ae42f895ac9013faf06841 2023-02-11 19:55:22,111 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family2/c5e29be64d8f4e40b0536b4a879e39a8 2023-02-11 19:55:22,115 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family1/616ddda77da84c3a837506544b7cb109 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/616ddda77da84c3a837506544b7cb109 2023-02-11 19:55:22,118 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/616ddda77da84c3a837506544b7cb109, entries=4, sequenceid=9, filesize=5.4 K 2023-02-11 19:55:22,118 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family2/c5e29be64d8f4e40b0536b4a879e39a8 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/c5e29be64d8f4e40b0536b4a879e39a8 2023-02-11 19:55:22,121 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/c5e29be64d8f4e40b0536b4a879e39a8, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 19:55:22,122 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 42f2c6a1e29ae18303d02e7977b355c5 in 859ms, sequenceid=9, compaction requested=false 2023-02-11 19:55:22,122 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 42f2c6a1e29ae18303d02e7977b355c5: 2023-02-11 19:55:22,122 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:22,122 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 19:55:22,506 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302114bec32ec1cab4ec98feac8ebf325ce90 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302114bec32ec1cab4ec98feac8ebf325ce90 2023-02-11 19:55:22,506 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211b802cff8a4954dada1264037c81e4eb3 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211b802cff8a4954dada1264037c81e4eb3 2023-02-11 19:55:22,578 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 19:55:22,911 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family2/8a5a90da6ec842cb8b44d6b14cf6d9f0 2023-02-11 19:55:22,911 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family2/08d5567e077741848dbd58da76b14e91 2023-02-11 19:55:22,916 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family1/df7b960c05ae42f895ac9013faf06841 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/df7b960c05ae42f895ac9013faf06841 2023-02-11 19:55:22,916 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family1/8c27cc08c9ab4d6d9e67df97f16c94a5 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/8c27cc08c9ab4d6d9e67df97f16c94a5 2023-02-11 19:55:22,919 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/df7b960c05ae42f895ac9013faf06841, entries=4, sequenceid=9, filesize=5.4 K 2023-02-11 19:55:22,920 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family2/8a5a90da6ec842cb8b44d6b14cf6d9f0 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/8a5a90da6ec842cb8b44d6b14cf6d9f0 2023-02-11 19:55:22,920 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/8c27cc08c9ab4d6d9e67df97f16c94a5, entries=4, sequenceid=9, filesize=5.4 K 2023-02-11 19:55:22,921 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family2/08d5567e077741848dbd58da76b14e91 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/08d5567e077741848dbd58da76b14e91 2023-02-11 19:55:22,924 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/8a5a90da6ec842cb8b44d6b14cf6d9f0, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 19:55:22,924 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/08d5567e077741848dbd58da76b14e91, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 19:55:22,924 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 41e9cd5e0c2aceca461c1cf15a182b3c in 1660ms, sequenceid=9, compaction requested=false 2023-02-11 19:55:22,924 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 41e9cd5e0c2aceca461c1cf15a182b3c: 2023-02-11 19:55:22,924 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:22,924 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 0086a9a022be72d7afa868235730b454 in 1660ms, sequenceid=9, compaction requested=false 2023-02-11 19:55:22,924 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 19:55:22,924 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0086a9a022be72d7afa868235730b454: 2023-02-11 19:55:22,925 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:22,925 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 19:55:22,925 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 19:55:22,925 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:22,925 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-11 19:55:22,925 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-11 19:55:22,926 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:22,926 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:22,926 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:22,926 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:55:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:22,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:22,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:22,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:22,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:22,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-11 19:55:22,928 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43163af9[Count = 0] remaining members to acquire global barrier 2023-02-11 19:55:22,928 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-11 19:55:22,928 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:22,929 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:22,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:22,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:22,929 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-11 19:55:22,929 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-11 19:55:22,929 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:55:22,929 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:22,929 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:55:22,930 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-11 19:55:22,930 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:22,930 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:22,930 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-11 19:55:22,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:22,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:22,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:22,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:22,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:22,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:22,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:22,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:22,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:22,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:22,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:55:22,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-11 19:55:22,932 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-11 19:55:22,932 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:55:22,932 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:55:22,932 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-11 19:55:22,932 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:55:22,936 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:22,936 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:22,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:22,936 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:22,936 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:22,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:22,937 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:22,939 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:22,939 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:22,939 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:22,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:22,939 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:22,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:22,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-11 19:55:22,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:55:22,939 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:22,939 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:22,939 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:22,939 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:22,939 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:22,939 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:22,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-11 19:55:22,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:22,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:22,939 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-11 19:55:22,940 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:55:23,040 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:55:23,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:55:23,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:23,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:23,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:23,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:55:23,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-11 19:55:23,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-11 19:55:23,046 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-11 19:55:23,046 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:23,046 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-11 19:55:23,046 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-11 19:55:23,046 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:23,047 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:23,048 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:23,048 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:23,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:23,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:23,048 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:23,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:23,048 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:55:23,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:23,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:55:23,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:23,049 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-11 19:55:23,049 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-11 19:55:23,049 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-11 19:55:23,049 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-11 19:55:23,049 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:23,049 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-11 19:55:23,049 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:23,049 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. started... 2023-02-11 19:55:23,049 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 19:55:23,049 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:55:23,049 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:23,049 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 42f2c6a1e29ae18303d02e7977b355c5 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 19:55:23,049 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:23,050 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. started... 2023-02-11 19:55:23,050 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. started... 2023-02-11 19:55:23,050 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0086a9a022be72d7afa868235730b454 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 19:55:23,050 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 41e9cd5e0c2aceca461c1cf15a182b3c 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 19:55:23,064 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302114f663333d194492bb06e1f50277ae654 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302114f663333d194492bb06e1f50277ae654 2023-02-11 19:55:23,065 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211f6bf7a03f7364e4a8299590d74dc142c to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211f6bf7a03f7364e4a8299590d74dc142c 2023-02-11 19:55:23,065 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211514eda33fdee499e8032350fce2d0ea3 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211514eda33fdee499e8032350fce2d0ea3 2023-02-11 19:55:23,472 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family1/3533a49f68aa47c793072c555eced063 2023-02-11 19:55:23,472 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family1/ca381d4e2fb14218b51cb252f8c11562 2023-02-11 19:55:23,472 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family1/b4986457dac84dfebca8accc078c2389 2023-02-11 19:55:23,494 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021135c31c98403e423fbecbf73a1ba02632 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021135c31c98403e423fbecbf73a1ba02632 2023-02-11 19:55:23,893 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302112583ae85ca3f4e209ba30c623546266f to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302112583ae85ca3f4e209ba30c623546266f 2023-02-11 19:55:23,893 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021148e6b54ffcf649c59ae03f59afa6e4af to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021148e6b54ffcf649c59ae03f59afa6e4af 2023-02-11 19:55:23,898 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family2/5110c81cf90a4b1f9698c8270d2ed018 2023-02-11 19:55:23,898 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family2/1545ab26592045bca34bf17dc9efd3d6 2023-02-11 19:55:23,903 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family1/ca381d4e2fb14218b51cb252f8c11562 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/ca381d4e2fb14218b51cb252f8c11562 2023-02-11 19:55:23,903 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family1/3533a49f68aa47c793072c555eced063 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/3533a49f68aa47c793072c555eced063 2023-02-11 19:55:23,906 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/ca381d4e2fb14218b51cb252f8c11562, entries=4, sequenceid=13, filesize=5.4 K 2023-02-11 19:55:23,906 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/3533a49f68aa47c793072c555eced063, entries=4, sequenceid=13, filesize=5.4 K 2023-02-11 19:55:23,907 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family2/5110c81cf90a4b1f9698c8270d2ed018 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/5110c81cf90a4b1f9698c8270d2ed018 2023-02-11 19:55:23,907 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family2/1545ab26592045bca34bf17dc9efd3d6 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/1545ab26592045bca34bf17dc9efd3d6 2023-02-11 19:55:23,910 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/5110c81cf90a4b1f9698c8270d2ed018, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 19:55:23,911 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/1545ab26592045bca34bf17dc9efd3d6, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 19:55:23,911 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 41e9cd5e0c2aceca461c1cf15a182b3c in 861ms, sequenceid=13, compaction requested=true 2023-02-11 19:55:23,911 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 41e9cd5e0c2aceca461c1cf15a182b3c: 2023-02-11 19:55:23,911 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:23,911 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 19:55:23,911 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 42f2c6a1e29ae18303d02e7977b355c5 in 862ms, sequenceid=13, compaction requested=true 2023-02-11 19:55:23,911 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 42f2c6a1e29ae18303d02e7977b355c5: 2023-02-11 19:55:23,911 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:23,911 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 19:55:24,299 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family2/df4dd57fefc6452a9613eca356e0e6bf 2023-02-11 19:55:24,303 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family1/b4986457dac84dfebca8accc078c2389 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/b4986457dac84dfebca8accc078c2389 2023-02-11 19:55:24,307 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/b4986457dac84dfebca8accc078c2389, entries=4, sequenceid=13, filesize=5.4 K 2023-02-11 19:55:24,308 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family2/df4dd57fefc6452a9613eca356e0e6bf as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/df4dd57fefc6452a9613eca356e0e6bf 2023-02-11 19:55:24,311 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/df4dd57fefc6452a9613eca356e0e6bf, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 19:55:24,312 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 0086a9a022be72d7afa868235730b454 in 1262ms, sequenceid=13, compaction requested=true 2023-02-11 19:55:24,312 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0086a9a022be72d7afa868235730b454: 2023-02-11 19:55:24,312 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:24,312 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 19:55:24,312 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 19:55:24,312 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:24,312 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-11 19:55:24,312 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-11 19:55:24,314 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:24,314 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:24,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:24,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:24,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:24,314 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:24,314 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:55:24,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:24,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:24,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:24,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:24,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:24,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-11 19:55:24,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@362e625a[Count = 0] remaining members to acquire global barrier 2023-02-11 19:55:24,316 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-11 19:55:24,316 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:24,318 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:24,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:24,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:24,318 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-11 19:55:24,318 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-11 19:55:24,318 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:24,318 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:55:24,318 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:55:24,322 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-11 19:55:24,322 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:24,322 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:24,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:24,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:24,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:24,322 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-11 19:55:24,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:24,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:24,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:24,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:24,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:24,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:24,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:24,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:55:24,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-11 19:55:24,325 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-11 19:55:24,325 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:55:24,325 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:55:24,325 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-11 19:55:24,325 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:55:24,326 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:24,326 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:24,326 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:24,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:24,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:24,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:24,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:24,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:24,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:24,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:24,327 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:24,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:24,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:24,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:24,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:24,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:24,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:24,328 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:24,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:24,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:24,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:24,331 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:24,331 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:24,331 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:24,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:24,331 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:24,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-11 19:55:24,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:24,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-11 19:55:24,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:55:24,331 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:24,331 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:24,331 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:24,331 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:24,331 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:24,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:24,331 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-11 19:55:24,331 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:24,331 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:55:24,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:24,432 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:55:24,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:55:24,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:24,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:24,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:24,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:55:24,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-11 19:55:24,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-11 19:55:24,438 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-11 19:55:24,438 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:24,438 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-11 19:55:24,438 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-11 19:55:24,438 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:24,439 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:24,440 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:24,440 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:24,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:24,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:24,440 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:24,440 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:55:24,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:24,440 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:24,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:55:24,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:24,441 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-11 19:55:24,441 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-11 19:55:24,441 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-11 19:55:24,441 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-11 19:55:24,441 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:24,441 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-11 19:55:24,443 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:24,443 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:24,444 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. started... 2023-02-11 19:55:24,444 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. started... 2023-02-11 19:55:24,444 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:24,444 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. started... 2023-02-11 19:55:24,444 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 42f2c6a1e29ae18303d02e7977b355c5 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 19:55:24,444 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 41e9cd5e0c2aceca461c1cf15a182b3c 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 19:55:24,444 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 19:55:24,444 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0086a9a022be72d7afa868235730b454 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 19:55:24,444 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:55:24,783 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-11 19:55:24,863 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302117e5fff121ed14e208d0cd837517a9824 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302117e5fff121ed14e208d0cd837517a9824 2023-02-11 19:55:24,864 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021153c57c1a385f456c93a75031416c9cdb to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021153c57c1a385f456c93a75031416c9cdb 2023-02-11 19:55:24,864 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211ac9d31f8f27f4b52a4141b5fd535e2ea to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211ac9d31f8f27f4b52a4141b5fd535e2ea 2023-02-11 19:55:25,268 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family1/9ceb0ccd412f4f0d9ac61b6ad8f07f73 2023-02-11 19:55:25,268 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family1/cea5ccdcd7a845eba63ea3a33fd78e36 2023-02-11 19:55:25,269 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family1/817c372a31c64a729c128640168c3f2a 2023-02-11 19:55:25,686 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211af44d94db61141229520baf48b9d02d5 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211af44d94db61141229520baf48b9d02d5 2023-02-11 19:55:25,687 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211e5d183efc4bd43fca45ccab8870cc052 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211e5d183efc4bd43fca45ccab8870cc052 2023-02-11 19:55:25,688 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021166a6baee9c894709b7bc1002458cacbd to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021166a6baee9c894709b7bc1002458cacbd 2023-02-11 19:55:25,692 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family2/f6829a954d6e44609741440a3acfc4a7 2023-02-11 19:55:25,695 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family1/cea5ccdcd7a845eba63ea3a33fd78e36 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/cea5ccdcd7a845eba63ea3a33fd78e36 2023-02-11 19:55:25,699 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/cea5ccdcd7a845eba63ea3a33fd78e36, entries=4, sequenceid=17, filesize=5.4 K 2023-02-11 19:55:25,700 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family2/f6829a954d6e44609741440a3acfc4a7 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/f6829a954d6e44609741440a3acfc4a7 2023-02-11 19:55:25,703 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/f6829a954d6e44609741440a3acfc4a7, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 19:55:25,704 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 0086a9a022be72d7afa868235730b454 in 1260ms, sequenceid=17, compaction requested=true 2023-02-11 19:55:25,704 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0086a9a022be72d7afa868235730b454: 2023-02-11 19:55:25,704 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:25,704 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 19:55:26,092 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family2/1a8baca107dc4039b450d62d971f2a85 2023-02-11 19:55:26,093 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family2/c274a0499f9c4b50a03fd9f9868b0a5b 2023-02-11 19:55:26,096 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family1/817c372a31c64a729c128640168c3f2a as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/817c372a31c64a729c128640168c3f2a 2023-02-11 19:55:26,096 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family1/9ceb0ccd412f4f0d9ac61b6ad8f07f73 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/9ceb0ccd412f4f0d9ac61b6ad8f07f73 2023-02-11 19:55:26,100 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/817c372a31c64a729c128640168c3f2a, entries=4, sequenceid=17, filesize=5.4 K 2023-02-11 19:55:26,100 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/9ceb0ccd412f4f0d9ac61b6ad8f07f73, entries=4, sequenceid=17, filesize=5.4 K 2023-02-11 19:55:26,100 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family2/1a8baca107dc4039b450d62d971f2a85 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/1a8baca107dc4039b450d62d971f2a85 2023-02-11 19:55:26,101 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family2/c274a0499f9c4b50a03fd9f9868b0a5b as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/c274a0499f9c4b50a03fd9f9868b0a5b 2023-02-11 19:55:26,105 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/1a8baca107dc4039b450d62d971f2a85, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 19:55:26,105 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/c274a0499f9c4b50a03fd9f9868b0a5b, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 19:55:26,105 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 41e9cd5e0c2aceca461c1cf15a182b3c in 1661ms, sequenceid=17, compaction requested=true 2023-02-11 19:55:26,105 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 42f2c6a1e29ae18303d02e7977b355c5 in 1661ms, sequenceid=17, compaction requested=true 2023-02-11 19:55:26,105 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 41e9cd5e0c2aceca461c1cf15a182b3c: 2023-02-11 19:55:26,105 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 42f2c6a1e29ae18303d02e7977b355c5: 2023-02-11 19:55:26,105 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:26,105 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:26,106 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 19:55:26,106 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 19:55:26,106 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 19:55:26,106 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:26,106 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-11 19:55:26,106 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-11 19:55:26,107 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:26,107 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:26,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:26,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:26,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:26,108 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:26,108 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:55:26,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:26,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:26,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:26,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:26,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:26,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-11 19:55:26,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3cf49f50[Count = 0] remaining members to acquire global barrier 2023-02-11 19:55:26,109 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-11 19:55:26,109 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:26,110 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:26,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:26,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:26,110 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-11 19:55:26,110 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-11 19:55:26,110 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:55:26,110 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:26,110 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:55:26,112 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:26,112 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-11 19:55:26,112 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:26,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:26,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:26,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:26,112 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-11 19:55:26,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:26,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:26,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:26,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:26,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:26,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:26,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:26,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:55:26,114 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-11 19:55:26,114 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:55:26,114 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:55:26,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-11 19:55:26,114 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-11 19:55:26,114 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:55:26,116 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:26,116 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:26,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:26,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:26,116 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:26,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:26,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:26,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:26,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:26,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:26,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:26,117 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:26,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:26,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:26,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:26,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:26,117 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:26,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:26,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:26,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:26,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:26,119 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:26,119 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:26,119 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:26,119 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:26,119 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:26,119 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:26,119 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:26,119 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:26,119 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:26,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:26,119 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:26,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:26,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-11 19:55:26,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:55:26,119 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-11 19:55:26,120 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-11 19:55:26,120 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:55:26,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:26,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:26,220 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:55:26,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:55:26,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1676145326221 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-11 19:55:26,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676145326231 (current time:1676145326231). 2023-02-11 19:55:26,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 19:55:26,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] zookeeper.ReadOnlyZKClient(139): Connect 0x1fe0c0fd to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:55:26,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fc59de3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:55:26,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:55:26,245 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60870, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:55:26,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fe0c0fd to 127.0.0.1:64025 2023-02-11 19:55:26,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:55:26,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 19:55:26,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1676145326221 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-11 19:55:26,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-11 19:55:26,255 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-11 19:55:26,255 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1676145926255 2023-02-11 19:55:26,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1676145326221 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-11 19:55:26,256 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1676145326221 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-11 19:55:26,257 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-11 19:55:26,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-11 19:55:26,258 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-02-11 19:55:26,258 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-11 19:55:26,259 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1676145926258 2023-02-11 19:55:26,261 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1676145326221 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-11 19:55:26,261 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 19:55:26,361 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:55:26,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676145326221 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 19:55:26,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676145326221 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:55:26,365 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 19:55:26,565 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:55:26,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676145326221 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 19:55:26,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676145326221 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:55:26,566 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-11 19:55:26,665 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1676145326221 2023-02-11 19:55:26,665 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1676145326221' 2023-02-11 19:55:26,665 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 19:55:26,665 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1676145326221' starting 'acquire' 2023-02-11 19:55:26,665 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1676145326221', kicking off acquire phase on members. 2023-02-11 19:55:26,666 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1676145326221 2023-02-11 19:55:26,666 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1676145326221 2023-02-11 19:55:26,667 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1676145326221/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:26,667 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:55:26,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:55:26,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:55:26,667 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1676145326221/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:26,667 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:55:26,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1676145326221 2023-02-11 19:55:26,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1676145326221 2023-02-11 19:55:26,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-11 19:55:26,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1676145326221 2023-02-11 19:55:26,668 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1676145326221 from table testCompactionWithHFileLink type FLUSH 2023-02-11 19:55:26,671 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1676145326221 2023-02-11 19:55:26,672 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1676145326221' with timeout 300000ms 2023-02-11 19:55:26,672 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 19:55:26,672 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1676145326221' starting 'acquire' stage 2023-02-11 19:55:26,672 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1676145326221' locally acquired 2023-02-11 19:55:26,672 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (snaptb-1676145326221) in zk 2023-02-11 19:55:26,673 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676145326221/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:26,673 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1676145326221 2023-02-11 19:55:26,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1676145326221/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:26,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:26,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:55:26,673 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1676145326221 2023-02-11 19:55:26,674 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1676145326221' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:55:26,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:26,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:26,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676145326221 2023-02-11 19:55:26,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:26,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:26,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'snaptb-1676145326221' on coordinator 2023-02-11 19:55:26,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17157c32[Count = 0] remaining members to acquire global barrier 2023-02-11 19:55:26,675 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1676145326221' starting 'in-barrier' execution. 2023-02-11 19:55:26,675 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1676145326221 2023-02-11 19:55:26,676 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676145326221 2023-02-11 19:55:26,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1676145326221 2023-02-11 19:55:26,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1676145326221 2023-02-11 19:55:26,676 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1676145326221' received 'reached' from coordinator. 2023-02-11 19:55:26,676 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1676145326221/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:26,676 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:55:26,677 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:26,677 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:26,677 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-02-11 19:55:26,677 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:26,677 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 19:55:26,677 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. started... 2023-02-11 19:55:26,677 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. started... 2023-02-11 19:55:26,677 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. started... 2023-02-11 19:55:26,677 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 41e9cd5e0c2aceca461c1cf15a182b3c: 2023-02-11 19:55:26,677 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 0086a9a022be72d7afa868235730b454: 2023-02-11 19:55:26,677 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 42f2c6a1e29ae18303d02e7977b355c5: 2023-02-11 19:55:26,678 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5.' region-info for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,678 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454.' region-info for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,678 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c.' region-info for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,683 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:55:26,683 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:55:26,683 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:55:26,686 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/0043e881679c4aafb4daf958eaca931b, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/8c27cc08c9ab4d6d9e67df97f16c94a5, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/b4986457dac84dfebca8accc078c2389, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/cea5ccdcd7a845eba63ea3a33fd78e36] hfiles 2023-02-11 19:55:26,686 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/62dedfe0ab4243159cc965af16601edc, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/df7b960c05ae42f895ac9013faf06841, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/ca381d4e2fb14218b51cb252f8c11562, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/817c372a31c64a729c128640168c3f2a] hfiles 2023-02-11 19:55:26,686 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/79aa122c58d142cdbb2e5673a05d98f5, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/616ddda77da84c3a837506544b7cb109, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/3533a49f68aa47c793072c555eced063, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/9ceb0ccd412f4f0d9ac61b6ad8f07f73] hfiles 2023-02-11 19:55:26,687 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/62dedfe0ab4243159cc965af16601edc for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,687 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/79aa122c58d142cdbb2e5673a05d98f5 for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,686 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/0043e881679c4aafb4daf958eaca931b for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,833 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-02-11 19:55:26,838 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d0d21b2 to 127.0.0.1:64025 2023-02-11 19:55:26,838 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:55:26,838 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:55:26,838 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47aed2db to 127.0.0.1:64025 2023-02-11 19:55:26,838 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:55:26,838 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:55:26,838 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x496ff499 to 127.0.0.1:64025 2023-02-11 19:55:26,838 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:55:26,841 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/df7b960c05ae42f895ac9013faf06841 for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,841 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/616ddda77da84c3a837506544b7cb109 for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,841 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/8c27cc08c9ab4d6d9e67df97f16c94a5 for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,841 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/3533a49f68aa47c793072c555eced063 for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,841 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/ca381d4e2fb14218b51cb252f8c11562 for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,841 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/9ceb0ccd412f4f0d9ac61b6ad8f07f73 for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,841 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/b4986457dac84dfebca8accc078c2389 for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,841 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/817c372a31c64a729c128640168c3f2a for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,841 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/cea5ccdcd7a845eba63ea3a33fd78e36 for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,841 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/b9364ca0030f4bfe9f7a345dc3efb560, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/c5e29be64d8f4e40b0536b4a879e39a8, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/1545ab26592045bca34bf17dc9efd3d6, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/c274a0499f9c4b50a03fd9f9868b0a5b] hfiles 2023-02-11 19:55:26,841 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/10dfe7d4feb94f329cd6f96056c69c63, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/08d5567e077741848dbd58da76b14e91, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/df4dd57fefc6452a9613eca356e0e6bf, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/f6829a954d6e44609741440a3acfc4a7] hfiles 2023-02-11 19:55:26,842 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/10dfe7d4feb94f329cd6f96056c69c63 for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,841 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/b9364ca0030f4bfe9f7a345dc3efb560 for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,841 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/97eef38102724ed2b51e73049cb17d47, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/8a5a90da6ec842cb8b44d6b14cf6d9f0, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/5110c81cf90a4b1f9698c8270d2ed018, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/1a8baca107dc4039b450d62d971f2a85] hfiles 2023-02-11 19:55:26,842 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/97eef38102724ed2b51e73049cb17d47 for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,842 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/c5e29be64d8f4e40b0536b4a879e39a8 for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,842 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/08d5567e077741848dbd58da76b14e91 for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,842 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/1545ab26592045bca34bf17dc9efd3d6 for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,842 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/df4dd57fefc6452a9613eca356e0e6bf for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,842 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/8a5a90da6ec842cb8b44d6b14cf6d9f0 for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,842 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/f6829a954d6e44609741440a3acfc4a7 for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,842 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/c274a0499f9c4b50a03fd9f9868b0a5b for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,842 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/5110c81cf90a4b1f9698c8270d2ed018 for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,842 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/1a8baca107dc4039b450d62d971f2a85 for snapshot=snaptb-1676145326221 2023-02-11 19:55:26,866 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:55:26,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676145326221 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 19:55:26,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676145326221 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:55:26,867 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-11 19:55:27,250 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. completed. 2023-02-11 19:55:27,250 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:27,250 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. completed. 2023-02-11 19:55:27,250 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:27,250 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-02-11 19:55:27,250 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-02-11 19:55:27,251 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. completed. 2023-02-11 19:55:27,251 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:27,251 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-02-11 19:55:27,251 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-02-11 19:55:27,251 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:27,251 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1676145326221' locally completed 2023-02-11 19:55:27,251 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1676145326221' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:55:27,253 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676145326221/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:27,253 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1676145326221' has notified controller of completion 2023-02-11 19:55:27,253 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:27,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1676145326221/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:27,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:27,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:55:27,253 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1676145326221' completed. 2023-02-11 19:55:27,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:27,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:27,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676145326221 2023-02-11 19:55:27,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:27,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:27,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676145326221 2023-02-11 19:55:27,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:27,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1676145326221' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:55:27,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'snaptb-1676145326221', counting down latch. Waiting for 0 more 2023-02-11 19:55:27,255 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1676145326221' execution completed 2023-02-11 19:55:27,255 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:55:27,255 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:55:27,255 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1676145326221 2023-02-11 19:55:27,255 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1676145326221including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 19:55:27,256 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676145326221 2023-02-11 19:55:27,256 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676145326221 2023-02-11 19:55:27,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1676145326221 2023-02-11 19:55:27,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:27,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:55:27,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1676145326221 2023-02-11 19:55:27,257 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:55:27,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1676145326221 2023-02-11 19:55:27,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:27,257 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1676145326221/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:27,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:55:27,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:55:27,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676145326221 2023-02-11 19:55:27,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1676145326221 2023-02-11 19:55:27,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:27,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676145326221 2023-02-11 19:55:27,258 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1676145326221/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:27,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:27,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:27,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676145326221 2023-02-11 19:55:27,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:27,261 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676145326221/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:27,261 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676145326221 2023-02-11 19:55:27,261 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:55:27,261 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676145326221 2023-02-11 19:55:27,261 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:55:27,261 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676145326221/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:27,261 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1676145326221 2023-02-11 19:55:27,261 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:27,261 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-02-11 19:55:27,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:55:27,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:55:27,261 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676145326221 2023-02-11 19:55:27,261 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1676145326221 because node does not exist (not an error) 2023-02-11 19:55:27,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1676145326221 2023-02-11 19:55:27,261 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676145326221 2023-02-11 19:55:27,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-02-11 19:55:27,261 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676145326221 2023-02-11 19:55:27,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:55:27,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:55:27,262 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021110b4444813bd45d3a803e3041d64b560, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211514eda33fdee499e8032350fce2d0ea3, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302116efc758a310747efacf0581ad538aff3, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211ac9d31f8f27f4b52a4141b5fd535e2ea, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302111bd25a41a8d742bcbc6215d6214e492e, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302111cf551d1e927405d8ca52c8c3eaac980, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302114f663333d194492bb06e1f50277ae654, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302117e5fff121ed14e208d0cd837517a9824, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302114a43cb1a719b43a4a8cf8695d755a199, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021153c57c1a385f456c93a75031416c9cdb, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211f5280f8bfa5e498b9fa4d88fa42c0790, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211f6bf7a03f7364e4a8299590d74dc142c] mob files 2023-02-11 19:55:27,262 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021110b4444813bd45d3a803e3041d64b560 2023-02-11 19:55:27,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211514eda33fdee499e8032350fce2d0ea3 2023-02-11 19:55:27,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302116efc758a310747efacf0581ad538aff3 2023-02-11 19:55:27,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211ac9d31f8f27f4b52a4141b5fd535e2ea 2023-02-11 19:55:27,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302111bd25a41a8d742bcbc6215d6214e492e 2023-02-11 19:55:27,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302111cf551d1e927405d8ca52c8c3eaac980 2023-02-11 19:55:27,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302114f663333d194492bb06e1f50277ae654 2023-02-11 19:55:27,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302117e5fff121ed14e208d0cd837517a9824 2023-02-11 19:55:27,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302114a43cb1a719b43a4a8cf8695d755a199 2023-02-11 19:55:27,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021153c57c1a385f456c93a75031416c9cdb 2023-02-11 19:55:27,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211f5280f8bfa5e498b9fa4d88fa42c0790 2023-02-11 19:55:27,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211f6bf7a03f7364e4a8299590d74dc142c 2023-02-11 19:55:27,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211197593bd71dc46bdb87b936d2dd523d9, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302112583ae85ca3f4e209ba30c623546266f, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302114bec32ec1cab4ec98feac8ebf325ce90, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211af44d94db61141229520baf48b9d02d5, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021135c31c98403e423fbecbf73a1ba02632, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211422794b6235048f99246437e13f22796, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021166a6baee9c894709b7bc1002458cacbd, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211b0c8a4d24dcb4569a6268d1638945892, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302110521519962064bcaae6dfc38448f8981, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021148e6b54ffcf649c59ae03f59afa6e4af, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211b802cff8a4954dada1264037c81e4eb3, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211e5d183efc4bd43fca45ccab8870cc052] mob files 2023-02-11 19:55:27,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211197593bd71dc46bdb87b936d2dd523d9 2023-02-11 19:55:27,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302112583ae85ca3f4e209ba30c623546266f 2023-02-11 19:55:27,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302114bec32ec1cab4ec98feac8ebf325ce90 2023-02-11 19:55:27,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211af44d94db61141229520baf48b9d02d5 2023-02-11 19:55:27,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021135c31c98403e423fbecbf73a1ba02632 2023-02-11 19:55:27,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211422794b6235048f99246437e13f22796 2023-02-11 19:55:27,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021166a6baee9c894709b7bc1002458cacbd 2023-02-11 19:55:27,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211b0c8a4d24dcb4569a6268d1638945892 2023-02-11 19:55:27,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302110521519962064bcaae6dfc38448f8981 2023-02-11 19:55:27,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021148e6b54ffcf649c59ae03f59afa6e4af 2023-02-11 19:55:27,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211b802cff8a4954dada1264037c81e4eb3 2023-02-11 19:55:27,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211e5d183efc4bd43fca45ccab8870cc052 2023-02-11 19:55:27,367 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:55:27,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676145326221 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 19:55:27,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676145326221 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:55:27,368 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-11 19:55:27,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1676145326221 2023-02-11 19:55:27,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.hbase-snapshot/.tmp/snaptb-1676145326221 2023-02-11 19:55:28,110 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.hbase-snapshot/.tmp/snaptb-1676145326221 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.hbase-snapshot/snaptb-1676145326221 2023-02-11 19:55:28,370 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:55:28,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676145326221 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 19:55:28,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676145326221 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:55:28,377 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-02-11 19:55:28,527 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1676145326221 of table testCompactionWithHFileLink completed 2023-02-11 19:55:28,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.hbase-snapshot/.tmp/snaptb-1676145326221 2023-02-11 19:55:28,527 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.hbase-snapshot/.tmp/snaptb-1676145326221 2023-02-11 19:55:28,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1676145326221 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1676145326256Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1676145327669 (+1413 ms)Consolidate snapshot: snaptb-1676145326221 at 1676145327669Loading Region manifests for snaptb-1676145326221 at 1676145327669Writing data manifest for snaptb-1676145326221 at 1676145327678 (+9 ms)Verifying snapshot: snaptb-1676145326221 at 1676145328085 (+407 ms)Snapshot snaptb-1676145326221 of table testCompactionWithHFileLink completed at 1676145328527 (+442 ms) 2023-02-11 19:55:28,528 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-11 19:55:28,530 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 2.2710 sec 2023-02-11 19:55:30,286 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 19:55:30,377 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:55:30,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676145326221 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 19:55:30,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1676145326221 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 19:55:30,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:55:30,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-11 19:55:30,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-11 19:55:30,408 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-11 19:55:30,408 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:30,408 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-11 19:55:30,408 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-11 19:55:30,408 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:30,408 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:30,410 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:30,410 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:30,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:30,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:30,410 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:30,410 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:55:30,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:30,411 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:30,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:55:30,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:30,411 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-11 19:55:30,411 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-11 19:55:30,411 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-11 19:55:30,411 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:30,411 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-11 19:55:30,412 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:30,412 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. started... 2023-02-11 19:55:30,412 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 19:55:30,412 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 42f2c6a1e29ae18303d02e7977b355c5 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 19:55:30,412 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:30,412 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:55:30,412 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:30,412 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. started... 2023-02-11 19:55:30,412 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. started... 2023-02-11 19:55:30,412 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0086a9a022be72d7afa868235730b454 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 19:55:30,412 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 41e9cd5e0c2aceca461c1cf15a182b3c 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 19:55:30,424 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family1/6d46b8c89f8b4b1885c9ffd8c2a7f72c 2023-02-11 19:55:30,427 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d46b8c89f8b4b1885c9ffd8c2a7f72c 2023-02-11 19:55:30,436 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family2/ec10adc189064adbb18e847ae7892097 2023-02-11 19:55:30,438 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec10adc189064adbb18e847ae7892097 2023-02-11 19:55:30,439 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family1/6d46b8c89f8b4b1885c9ffd8c2a7f72c as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/6d46b8c89f8b4b1885c9ffd8c2a7f72c 2023-02-11 19:55:30,442 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d46b8c89f8b4b1885c9ffd8c2a7f72c 2023-02-11 19:55:30,442 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/6d46b8c89f8b4b1885c9ffd8c2a7f72c, entries=3, sequenceid=24, filesize=5.0 K 2023-02-11 19:55:30,442 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family2/ec10adc189064adbb18e847ae7892097 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/ec10adc189064adbb18e847ae7892097 2023-02-11 19:55:30,445 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec10adc189064adbb18e847ae7892097 2023-02-11 19:55:30,445 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/ec10adc189064adbb18e847ae7892097, entries=1, sequenceid=24, filesize=5.0 K 2023-02-11 19:55:30,446 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 41e9cd5e0c2aceca461c1cf15a182b3c in 34ms, sequenceid=24, compaction requested=true 2023-02-11 19:55:30,446 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 41e9cd5e0c2aceca461c1cf15a182b3c: 2023-02-11 19:55:30,446 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:30,446 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 19:55:31,225 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family1/375f53cc776c40d7928e535689e60fc9 2023-02-11 19:55:31,225 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family1/53110568e8f84ce4a8c7099ade10eeac 2023-02-11 19:55:31,229 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 53110568e8f84ce4a8c7099ade10eeac 2023-02-11 19:55:31,229 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 375f53cc776c40d7928e535689e60fc9 2023-02-11 19:55:32,047 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family2/ae11ddac0d1a4d3d93f4b5af81363689 2023-02-11 19:55:32,050 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family2/a31d6d62fe5146bfb984162c7a74c0cd 2023-02-11 19:55:32,051 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ae11ddac0d1a4d3d93f4b5af81363689 2023-02-11 19:55:32,052 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family1/53110568e8f84ce4a8c7099ade10eeac as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/53110568e8f84ce4a8c7099ade10eeac 2023-02-11 19:55:32,053 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a31d6d62fe5146bfb984162c7a74c0cd 2023-02-11 19:55:32,053 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family1/375f53cc776c40d7928e535689e60fc9 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/375f53cc776c40d7928e535689e60fc9 2023-02-11 19:55:32,055 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 53110568e8f84ce4a8c7099ade10eeac 2023-02-11 19:55:32,055 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/53110568e8f84ce4a8c7099ade10eeac, entries=3, sequenceid=24, filesize=5.0 K 2023-02-11 19:55:32,056 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family2/ae11ddac0d1a4d3d93f4b5af81363689 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/ae11ddac0d1a4d3d93f4b5af81363689 2023-02-11 19:55:32,057 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 375f53cc776c40d7928e535689e60fc9 2023-02-11 19:55:32,057 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/375f53cc776c40d7928e535689e60fc9, entries=3, sequenceid=24, filesize=5.0 K 2023-02-11 19:55:32,057 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family2/a31d6d62fe5146bfb984162c7a74c0cd as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/a31d6d62fe5146bfb984162c7a74c0cd 2023-02-11 19:55:32,059 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ae11ddac0d1a4d3d93f4b5af81363689 2023-02-11 19:55:32,060 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/ae11ddac0d1a4d3d93f4b5af81363689, entries=1, sequenceid=24, filesize=5.0 K 2023-02-11 19:55:32,060 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 0086a9a022be72d7afa868235730b454 in 1648ms, sequenceid=24, compaction requested=true 2023-02-11 19:55:32,060 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0086a9a022be72d7afa868235730b454: 2023-02-11 19:55:32,060 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:32,060 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 19:55:32,061 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a31d6d62fe5146bfb984162c7a74c0cd 2023-02-11 19:55:32,061 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/a31d6d62fe5146bfb984162c7a74c0cd, entries=1, sequenceid=24, filesize=5.0 K 2023-02-11 19:55:32,062 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 42f2c6a1e29ae18303d02e7977b355c5 in 1650ms, sequenceid=24, compaction requested=true 2023-02-11 19:55:32,062 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 42f2c6a1e29ae18303d02e7977b355c5: 2023-02-11 19:55:32,062 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:32,062 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 19:55:32,062 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 19:55:32,062 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:32,062 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-11 19:55:32,062 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-11 19:55:32,064 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:32,064 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:32,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:32,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:32,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:32,064 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:32,064 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:55:32,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:32,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:32,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:32,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:32,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:32,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-11 19:55:32,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65265ddb[Count = 0] remaining members to acquire global barrier 2023-02-11 19:55:32,065 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-11 19:55:32,065 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:32,069 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:32,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:32,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:32,069 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-11 19:55:32,069 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-11 19:55:32,069 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:32,069 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:55:32,069 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:55:32,072 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-11 19:55:32,072 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:32,072 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:32,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:32,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:32,072 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-11 19:55:32,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:32,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:32,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:32,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:32,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:32,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:32,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:32,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:32,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:55:32,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-11 19:55:32,074 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-11 19:55:32,074 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:55:32,074 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:55:32,074 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-11 19:55:32,074 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:55:32,075 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:32,075 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:32,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:32,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:32,075 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:32,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:32,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:32,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:32,077 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:32,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:32,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:32,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:32,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:32,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:32,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:32,078 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:32,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:32,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:32,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:32,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 19:55:32,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:32,079 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:32,079 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:32,079 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:32,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:32,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-11 19:55:32,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:55:32,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:32,079 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:32,079 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 19:55:32,079 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:32,080 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:32,080 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:32,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-11 19:55:32,080 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 19:55:32,080 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-11 19:55:32,080 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 19:55:32,080 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:55:32,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:32,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:32,180 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:55:32,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:55:32,182 DEBUG [Listener at localhost/32929] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 19:55:32,182 DEBUG [Listener at localhost/32929] regionserver.HStore(1912): 42f2c6a1e29ae18303d02e7977b355c5/family1 is initiating major compaction (all files) 2023-02-11 19:55:32,182 INFO [Listener at localhost/32929] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:55:32,182 INFO [Listener at localhost/32929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:55:32,182 INFO [Listener at localhost/32929] regionserver.HRegion(2258): Starting compaction of 42f2c6a1e29ae18303d02e7977b355c5/family1 in testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:32,182 INFO [Listener at localhost/32929] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/79aa122c58d142cdbb2e5673a05d98f5, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/616ddda77da84c3a837506544b7cb109, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/3533a49f68aa47c793072c555eced063, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/9ceb0ccd412f4f0d9ac61b6ad8f07f73, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/375f53cc776c40d7928e535689e60fc9] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp, totalSize=26.7 K 2023-02-11 19:55:32,183 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 79aa122c58d142cdbb2e5673a05d98f5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145319467 2023-02-11 19:55:32,183 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 616ddda77da84c3a837506544b7cb109, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145321251 2023-02-11 19:55:32,183 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 3533a49f68aa47c793072c555eced063, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145323042 2023-02-11 19:55:32,184 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 9ceb0ccd412f4f0d9ac61b6ad8f07f73, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145324434 2023-02-11 19:55:32,184 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 375f53cc776c40d7928e535689e60fc9, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-11 19:55:32,196 INFO [Listener at localhost/32929] throttle.PressureAwareThroughputController(145): 42f2c6a1e29ae18303d02e7977b355c5#family1#compaction#108 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:55:32,605 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230211af1cb33445e74a24b9154588ddcb185c_del 2023-02-11 19:55:32,605 INFO [Listener at localhost/32929] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211af1cb33445e74a24b9154588ddcb185c_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211af1cb33445e74a24b9154588ddcb185c_del 2023-02-11 19:55:33,418 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9961a0ef4c1948db99f48c79c04d2942 2023-02-11 19:55:33,419 DEBUG [Listener at localhost/32929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family1/9961a0ef4c1948db99f48c79c04d2942 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/9961a0ef4c1948db99f48c79c04d2942 2023-02-11 19:55:33,422 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9961a0ef4c1948db99f48c79c04d2942 2023-02-11 19:55:33,423 INFO [Listener at localhost/32929] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 42f2c6a1e29ae18303d02e7977b355c5/family1 of 42f2c6a1e29ae18303d02e7977b355c5 into 9961a0ef4c1948db99f48c79c04d2942(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 19:55:33,423 DEBUG [Listener at localhost/32929] regionserver.HRegion(2288): Compaction status journal for 42f2c6a1e29ae18303d02e7977b355c5: 2023-02-11 19:55:33,423 DEBUG [Listener at localhost/32929] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 19:55:33,423 DEBUG [Listener at localhost/32929] regionserver.HStore(1912): 42f2c6a1e29ae18303d02e7977b355c5/family2 is initiating major compaction (all files) 2023-02-11 19:55:33,423 INFO [Listener at localhost/32929] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:55:33,423 INFO [Listener at localhost/32929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:55:33,423 INFO [Listener at localhost/32929] regionserver.HRegion(2258): Starting compaction of 42f2c6a1e29ae18303d02e7977b355c5/family2 in testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:33,424 INFO [Listener at localhost/32929] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/b9364ca0030f4bfe9f7a345dc3efb560, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/c5e29be64d8f4e40b0536b4a879e39a8, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/1545ab26592045bca34bf17dc9efd3d6, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/c274a0499f9c4b50a03fd9f9868b0a5b, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/a31d6d62fe5146bfb984162c7a74c0cd] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp, totalSize=25.4 K 2023-02-11 19:55:33,424 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting b9364ca0030f4bfe9f7a345dc3efb560, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145319467 2023-02-11 19:55:33,424 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting c5e29be64d8f4e40b0536b4a879e39a8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145321251 2023-02-11 19:55:33,424 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 1545ab26592045bca34bf17dc9efd3d6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145323042 2023-02-11 19:55:33,425 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting c274a0499f9c4b50a03fd9f9868b0a5b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145324434 2023-02-11 19:55:33,425 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting a31d6d62fe5146bfb984162c7a74c0cd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-11 19:55:33,435 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/79aa122c58d142cdbb2e5673a05d98f5, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/616ddda77da84c3a837506544b7cb109, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/3533a49f68aa47c793072c555eced063, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/9ceb0ccd412f4f0d9ac61b6ad8f07f73, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/375f53cc776c40d7928e535689e60fc9] to archive 2023-02-11 19:55:33,435 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:33,435 INFO [Listener at localhost/32929] throttle.PressureAwareThroughputController(145): 42f2c6a1e29ae18303d02e7977b355c5#family2#compaction#109 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:55:33,436 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/79aa122c58d142cdbb2e5673a05d98f5 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/79aa122c58d142cdbb2e5673a05d98f5 2023-02-11 19:55:33,438 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/616ddda77da84c3a837506544b7cb109 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/616ddda77da84c3a837506544b7cb109 2023-02-11 19:55:33,439 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/3533a49f68aa47c793072c555eced063 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/3533a49f68aa47c793072c555eced063 2023-02-11 19:55:33,440 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/9ceb0ccd412f4f0d9ac61b6ad8f07f73 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/9ceb0ccd412f4f0d9ac61b6ad8f07f73 2023-02-11 19:55:33,441 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/375f53cc776c40d7928e535689e60fc9 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/375f53cc776c40d7928e535689e60fc9 2023-02-11 19:55:33,443 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230211381a0202c80a415fbd9ffc363ca37484_del 2023-02-11 19:55:33,443 INFO [Listener at localhost/32929] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211381a0202c80a415fbd9ffc363ca37484_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211381a0202c80a415fbd9ffc363ca37484_del 2023-02-11 19:55:34,258 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cfaa2a635a9441649c09fd301bdec55f 2023-02-11 19:55:34,258 DEBUG [Listener at localhost/32929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family2/cfaa2a635a9441649c09fd301bdec55f as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/cfaa2a635a9441649c09fd301bdec55f 2023-02-11 19:55:34,262 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cfaa2a635a9441649c09fd301bdec55f 2023-02-11 19:55:34,263 INFO [Listener at localhost/32929] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 42f2c6a1e29ae18303d02e7977b355c5/family2 of 42f2c6a1e29ae18303d02e7977b355c5 into cfaa2a635a9441649c09fd301bdec55f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 19:55:34,263 DEBUG [Listener at localhost/32929] regionserver.HRegion(2288): Compaction status journal for 42f2c6a1e29ae18303d02e7977b355c5: 2023-02-11 19:55:34,263 DEBUG [Listener at localhost/32929] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 19:55:34,263 DEBUG [Listener at localhost/32929] regionserver.HStore(1912): 0086a9a022be72d7afa868235730b454/family1 is initiating major compaction (all files) 2023-02-11 19:55:34,263 INFO [Listener at localhost/32929] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:55:34,263 INFO [Listener at localhost/32929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:55:34,263 INFO [Listener at localhost/32929] regionserver.HRegion(2258): Starting compaction of 0086a9a022be72d7afa868235730b454/family1 in testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:34,263 INFO [Listener at localhost/32929] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/0043e881679c4aafb4daf958eaca931b, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/8c27cc08c9ab4d6d9e67df97f16c94a5, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/b4986457dac84dfebca8accc078c2389, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/cea5ccdcd7a845eba63ea3a33fd78e36, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/53110568e8f84ce4a8c7099ade10eeac] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp, totalSize=26.7 K 2023-02-11 19:55:34,264 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 0043e881679c4aafb4daf958eaca931b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145319465 2023-02-11 19:55:34,264 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 8c27cc08c9ab4d6d9e67df97f16c94a5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145321251 2023-02-11 19:55:34,264 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting b4986457dac84dfebca8accc078c2389, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145323041 2023-02-11 19:55:34,265 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting cea5ccdcd7a845eba63ea3a33fd78e36, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145324433 2023-02-11 19:55:34,265 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 53110568e8f84ce4a8c7099ade10eeac, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-11 19:55:34,274 INFO [Listener at localhost/32929] throttle.PressureAwareThroughputController(145): 0086a9a022be72d7afa868235730b454#family1#compaction#110 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:55:34,334 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/b9364ca0030f4bfe9f7a345dc3efb560, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/c5e29be64d8f4e40b0536b4a879e39a8, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/1545ab26592045bca34bf17dc9efd3d6, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/c274a0499f9c4b50a03fd9f9868b0a5b, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/a31d6d62fe5146bfb984162c7a74c0cd] to archive 2023-02-11 19:55:34,334 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:34,336 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/b9364ca0030f4bfe9f7a345dc3efb560 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/b9364ca0030f4bfe9f7a345dc3efb560 2023-02-11 19:55:34,337 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/c5e29be64d8f4e40b0536b4a879e39a8 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/c5e29be64d8f4e40b0536b4a879e39a8 2023-02-11 19:55:34,338 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/1545ab26592045bca34bf17dc9efd3d6 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/1545ab26592045bca34bf17dc9efd3d6 2023-02-11 19:55:34,338 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/c274a0499f9c4b50a03fd9f9868b0a5b to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/c274a0499f9c4b50a03fd9f9868b0a5b 2023-02-11 19:55:34,339 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/a31d6d62fe5146bfb984162c7a74c0cd to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/a31d6d62fe5146bfb984162c7a74c0cd 2023-02-11 19:55:34,682 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302113baf570bfe1b4dc986cac0883bf8c82a_del 2023-02-11 19:55:34,682 INFO [Listener at localhost/32929] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302113baf570bfe1b4dc986cac0883bf8c82a_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302113baf570bfe1b4dc986cac0883bf8c82a_del 2023-02-11 19:55:35,496 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d8d57f3e16864074803225facf777d6e 2023-02-11 19:55:35,497 DEBUG [Listener at localhost/32929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family1/d8d57f3e16864074803225facf777d6e as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/d8d57f3e16864074803225facf777d6e 2023-02-11 19:55:35,500 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d8d57f3e16864074803225facf777d6e 2023-02-11 19:55:35,501 INFO [Listener at localhost/32929] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0086a9a022be72d7afa868235730b454/family1 of 0086a9a022be72d7afa868235730b454 into d8d57f3e16864074803225facf777d6e(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 19:55:35,501 DEBUG [Listener at localhost/32929] regionserver.HRegion(2288): Compaction status journal for 0086a9a022be72d7afa868235730b454: 2023-02-11 19:55:35,501 DEBUG [Listener at localhost/32929] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 19:55:35,501 DEBUG [Listener at localhost/32929] regionserver.HStore(1912): 0086a9a022be72d7afa868235730b454/family2 is initiating major compaction (all files) 2023-02-11 19:55:35,501 INFO [Listener at localhost/32929] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:55:35,501 INFO [Listener at localhost/32929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:55:35,501 INFO [Listener at localhost/32929] regionserver.HRegion(2258): Starting compaction of 0086a9a022be72d7afa868235730b454/family2 in testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:35,501 INFO [Listener at localhost/32929] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/10dfe7d4feb94f329cd6f96056c69c63, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/08d5567e077741848dbd58da76b14e91, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/df4dd57fefc6452a9613eca356e0e6bf, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/f6829a954d6e44609741440a3acfc4a7, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/ae11ddac0d1a4d3d93f4b5af81363689] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp, totalSize=25.4 K 2023-02-11 19:55:35,502 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 10dfe7d4feb94f329cd6f96056c69c63, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145319465 2023-02-11 19:55:35,502 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 08d5567e077741848dbd58da76b14e91, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145321251 2023-02-11 19:55:35,503 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting df4dd57fefc6452a9613eca356e0e6bf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145323041 2023-02-11 19:55:35,503 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting f6829a954d6e44609741440a3acfc4a7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145324433 2023-02-11 19:55:35,503 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting ae11ddac0d1a4d3d93f4b5af81363689, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-11 19:55:35,514 INFO [Listener at localhost/32929] throttle.PressureAwareThroughputController(145): 0086a9a022be72d7afa868235730b454#family2#compaction#111 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:55:35,535 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/0043e881679c4aafb4daf958eaca931b, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/8c27cc08c9ab4d6d9e67df97f16c94a5, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/b4986457dac84dfebca8accc078c2389, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/cea5ccdcd7a845eba63ea3a33fd78e36, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/53110568e8f84ce4a8c7099ade10eeac] to archive 2023-02-11 19:55:35,535 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:35,537 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/0043e881679c4aafb4daf958eaca931b to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/0043e881679c4aafb4daf958eaca931b 2023-02-11 19:55:35,538 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/8c27cc08c9ab4d6d9e67df97f16c94a5 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/8c27cc08c9ab4d6d9e67df97f16c94a5 2023-02-11 19:55:35,539 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/b4986457dac84dfebca8accc078c2389 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/b4986457dac84dfebca8accc078c2389 2023-02-11 19:55:35,540 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/cea5ccdcd7a845eba63ea3a33fd78e36 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/cea5ccdcd7a845eba63ea3a33fd78e36 2023-02-11 19:55:35,541 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/53110568e8f84ce4a8c7099ade10eeac to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/53110568e8f84ce4a8c7099ade10eeac 2023-02-11 19:55:35,922 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230211c56ff3894d65492e8d843700f5e6a463_del 2023-02-11 19:55:35,922 INFO [Listener at localhost/32929] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211c56ff3894d65492e8d843700f5e6a463_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211c56ff3894d65492e8d843700f5e6a463_del 2023-02-11 19:55:36,738 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 28cbc6741be940c58b171b6dc0ffe945 2023-02-11 19:55:36,739 DEBUG [Listener at localhost/32929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family2/28cbc6741be940c58b171b6dc0ffe945 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/28cbc6741be940c58b171b6dc0ffe945 2023-02-11 19:55:36,742 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 28cbc6741be940c58b171b6dc0ffe945 2023-02-11 19:55:36,743 INFO [Listener at localhost/32929] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0086a9a022be72d7afa868235730b454/family2 of 0086a9a022be72d7afa868235730b454 into 28cbc6741be940c58b171b6dc0ffe945(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 19:55:36,743 DEBUG [Listener at localhost/32929] regionserver.HRegion(2288): Compaction status journal for 0086a9a022be72d7afa868235730b454: 2023-02-11 19:55:36,743 DEBUG [Listener at localhost/32929] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 19:55:36,743 DEBUG [Listener at localhost/32929] regionserver.HStore(1912): 41e9cd5e0c2aceca461c1cf15a182b3c/family1 is initiating major compaction (all files) 2023-02-11 19:55:36,743 INFO [Listener at localhost/32929] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:55:36,743 INFO [Listener at localhost/32929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:55:36,743 INFO [Listener at localhost/32929] regionserver.HRegion(2258): Starting compaction of 41e9cd5e0c2aceca461c1cf15a182b3c/family1 in testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:36,743 INFO [Listener at localhost/32929] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/62dedfe0ab4243159cc965af16601edc, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/df7b960c05ae42f895ac9013faf06841, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/ca381d4e2fb14218b51cb252f8c11562, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/817c372a31c64a729c128640168c3f2a, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/6d46b8c89f8b4b1885c9ffd8c2a7f72c] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp, totalSize=26.7 K 2023-02-11 19:55:36,744 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 62dedfe0ab4243159cc965af16601edc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145319466 2023-02-11 19:55:36,744 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting df7b960c05ae42f895ac9013faf06841, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145321251 2023-02-11 19:55:36,744 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting ca381d4e2fb14218b51cb252f8c11562, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145323042 2023-02-11 19:55:36,744 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 817c372a31c64a729c128640168c3f2a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145324434 2023-02-11 19:55:36,744 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 6d46b8c89f8b4b1885c9ffd8c2a7f72c, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-11 19:55:36,753 INFO [Listener at localhost/32929] throttle.PressureAwareThroughputController(145): 41e9cd5e0c2aceca461c1cf15a182b3c#family1#compaction#112 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:55:36,835 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/10dfe7d4feb94f329cd6f96056c69c63, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/08d5567e077741848dbd58da76b14e91, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/df4dd57fefc6452a9613eca356e0e6bf, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/f6829a954d6e44609741440a3acfc4a7, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/ae11ddac0d1a4d3d93f4b5af81363689] to archive 2023-02-11 19:55:36,835 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:36,837 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/10dfe7d4feb94f329cd6f96056c69c63 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/10dfe7d4feb94f329cd6f96056c69c63 2023-02-11 19:55:36,839 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/08d5567e077741848dbd58da76b14e91 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/08d5567e077741848dbd58da76b14e91 2023-02-11 19:55:36,840 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/df4dd57fefc6452a9613eca356e0e6bf to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/df4dd57fefc6452a9613eca356e0e6bf 2023-02-11 19:55:36,841 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/f6829a954d6e44609741440a3acfc4a7 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/f6829a954d6e44609741440a3acfc4a7 2023-02-11 19:55:36,842 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/ae11ddac0d1a4d3d93f4b5af81363689 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/ae11ddac0d1a4d3d93f4b5af81363689 2023-02-11 19:55:37,161 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302115c39ac27b75b44f3aa3c354ccfbbb515_del 2023-02-11 19:55:37,162 INFO [Listener at localhost/32929] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302115c39ac27b75b44f3aa3c354ccfbbb515_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302115c39ac27b75b44f3aa3c354ccfbbb515_del 2023-02-11 19:55:37,976 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fbe42987076a4825a9a3afdf648fc1d1 2023-02-11 19:55:37,977 DEBUG [Listener at localhost/32929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family1/fbe42987076a4825a9a3afdf648fc1d1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/fbe42987076a4825a9a3afdf648fc1d1 2023-02-11 19:55:37,980 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fbe42987076a4825a9a3afdf648fc1d1 2023-02-11 19:55:37,981 INFO [Listener at localhost/32929] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 41e9cd5e0c2aceca461c1cf15a182b3c/family1 of 41e9cd5e0c2aceca461c1cf15a182b3c into fbe42987076a4825a9a3afdf648fc1d1(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 19:55:37,981 DEBUG [Listener at localhost/32929] regionserver.HRegion(2288): Compaction status journal for 41e9cd5e0c2aceca461c1cf15a182b3c: 2023-02-11 19:55:37,981 DEBUG [Listener at localhost/32929] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 19:55:37,981 DEBUG [Listener at localhost/32929] regionserver.HStore(1912): 41e9cd5e0c2aceca461c1cf15a182b3c/family2 is initiating major compaction (all files) 2023-02-11 19:55:37,981 INFO [Listener at localhost/32929] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:55:37,982 INFO [Listener at localhost/32929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:55:37,982 INFO [Listener at localhost/32929] regionserver.HRegion(2258): Starting compaction of 41e9cd5e0c2aceca461c1cf15a182b3c/family2 in testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:37,982 INFO [Listener at localhost/32929] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/97eef38102724ed2b51e73049cb17d47, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/8a5a90da6ec842cb8b44d6b14cf6d9f0, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/5110c81cf90a4b1f9698c8270d2ed018, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/1a8baca107dc4039b450d62d971f2a85, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/ec10adc189064adbb18e847ae7892097] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp, totalSize=25.4 K 2023-02-11 19:55:37,982 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 97eef38102724ed2b51e73049cb17d47, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145319466 2023-02-11 19:55:37,982 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 8a5a90da6ec842cb8b44d6b14cf6d9f0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145321251 2023-02-11 19:55:37,983 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 5110c81cf90a4b1f9698c8270d2ed018, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145323042 2023-02-11 19:55:37,983 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 1a8baca107dc4039b450d62d971f2a85, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145324434 2023-02-11 19:55:37,983 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting ec10adc189064adbb18e847ae7892097, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-11 19:55:38,000 INFO [Listener at localhost/32929] throttle.PressureAwareThroughputController(145): 41e9cd5e0c2aceca461c1cf15a182b3c#family2#compaction#113 average throughput is 0.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:55:38,034 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/62dedfe0ab4243159cc965af16601edc, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/df7b960c05ae42f895ac9013faf06841, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/ca381d4e2fb14218b51cb252f8c11562, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/817c372a31c64a729c128640168c3f2a, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/6d46b8c89f8b4b1885c9ffd8c2a7f72c] to archive 2023-02-11 19:55:38,035 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:38,037 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/62dedfe0ab4243159cc965af16601edc to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/62dedfe0ab4243159cc965af16601edc 2023-02-11 19:55:38,038 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/df7b960c05ae42f895ac9013faf06841 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/df7b960c05ae42f895ac9013faf06841 2023-02-11 19:55:38,039 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/ca381d4e2fb14218b51cb252f8c11562 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/ca381d4e2fb14218b51cb252f8c11562 2023-02-11 19:55:38,040 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/817c372a31c64a729c128640168c3f2a to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/817c372a31c64a729c128640168c3f2a 2023-02-11 19:55:38,041 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/6d46b8c89f8b4b1885c9ffd8c2a7f72c to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/6d46b8c89f8b4b1885c9ffd8c2a7f72c 2023-02-11 19:55:38,409 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230211eb8d2a87a22f42c1a38b939c5eb25623_del 2023-02-11 19:55:38,409 INFO [Listener at localhost/32929] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211eb8d2a87a22f42c1a38b939c5eb25623_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211eb8d2a87a22f42c1a38b939c5eb25623_del 2023-02-11 19:55:39,224 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 09d828aabc0b4bb5bec1531ab0ab3a61 2023-02-11 19:55:39,224 DEBUG [Listener at localhost/32929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family2/09d828aabc0b4bb5bec1531ab0ab3a61 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/09d828aabc0b4bb5bec1531ab0ab3a61 2023-02-11 19:55:39,228 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 09d828aabc0b4bb5bec1531ab0ab3a61 2023-02-11 19:55:39,229 INFO [Listener at localhost/32929] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 41e9cd5e0c2aceca461c1cf15a182b3c/family2 of 41e9cd5e0c2aceca461c1cf15a182b3c into 09d828aabc0b4bb5bec1531ab0ab3a61(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 19:55:39,229 DEBUG [Listener at localhost/32929] regionserver.HRegion(2288): Compaction status journal for 41e9cd5e0c2aceca461c1cf15a182b3c: 2023-02-11 19:55:39,233 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 19:55:39,237 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 19:55:39,238 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/97eef38102724ed2b51e73049cb17d47, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/8a5a90da6ec842cb8b44d6b14cf6d9f0, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/5110c81cf90a4b1f9698c8270d2ed018, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/1a8baca107dc4039b450d62d971f2a85, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/ec10adc189064adbb18e847ae7892097] to archive 2023-02-11 19:55:39,239 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:39,240 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/97eef38102724ed2b51e73049cb17d47 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/97eef38102724ed2b51e73049cb17d47 2023-02-11 19:55:39,241 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 19:55:39,242 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/8a5a90da6ec842cb8b44d6b14cf6d9f0 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/8a5a90da6ec842cb8b44d6b14cf6d9f0 2023-02-11 19:55:39,242 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 19:55:39,243 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/5110c81cf90a4b1f9698c8270d2ed018 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/5110c81cf90a4b1f9698c8270d2ed018 2023-02-11 19:55:39,244 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/1a8baca107dc4039b450d62d971f2a85 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/1a8baca107dc4039b450d62d971f2a85 2023-02-11 19:55:39,245 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/ec10adc189064adbb18e847ae7892097 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/ec10adc189064adbb18e847ae7892097 2023-02-11 19:55:39,246 INFO [Listener at localhost/32929] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-11 19:55:39,275 INFO [Listener at localhost/32929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-11 19:55:39,277 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302113baf570bfe1b4dc986cac0883bf8c82a_del 2023-02-11 19:55:39,280 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302115c39ac27b75b44f3aa3c354ccfbbb515_del 2023-02-11 19:55:39,282 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230211af1cb33445e74a24b9154588ddcb185c_del 2023-02-11 19:55:39,282 INFO [Listener at localhost/32929] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-11 19:55:39,283 DEBUG [Listener at localhost/32929] zookeeper.ReadOnlyZKClient(139): Connect 0x18639285 to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:55:39,287 DEBUG [Listener at localhost/32929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79e2a56f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:55:39,288 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 19:55:39,288 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 19:55:39,288 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 19:55:40,136 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302113243c08e41ac4df38e270d6771d5f958 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302113243c08e41ac4df38e270d6771d5f958 2023-02-11 19:55:40,137 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 19:55:40,137 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302118b06613aaf4f474d8122c99909c82445 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302118b06613aaf4f474d8122c99909c82445 2023-02-11 19:55:40,138 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 19:55:40,151 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:55:40,153 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302114637f6d0588343928a521617e63d3ec4 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302114637f6d0588343928a521617e63d3ec4 2023-02-11 19:55:40,155 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 19:55:40,155 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34472, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:55:40,161 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:55:40,163 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41744, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:55:40,183 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/be6df0e03b8f48a2aa1ec56a953cc6f3 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-11 19:55:40,184 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/be6df0e03b8f48a2aa1ec56a953cc6f3}] 2023-02-11 19:55:40,186 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/a41185cff4554c6783f24eb4276426e7 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-11 19:55:40,188 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/a41185cff4554c6783f24eb4276426e7}] 2023-02-11 19:55:40,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/be6df0e03b8f48a2aa1ec56a953cc6f3 for inclusion in 0086a9a022be72d7afa868235730b454/family1 2023-02-11 19:55:40,191 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/a41185cff4554c6783f24eb4276426e7 for inclusion in 41e9cd5e0c2aceca461c1cf15a182b3c/family1 2023-02-11 19:55:40,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-11 19:55:40,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last=1 2023-02-11 19:55:40,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-11 19:55:40,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-11 19:55:40,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 0086a9a022be72d7afa868235730b454: 2023-02-11 19:55:40,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 41e9cd5e0c2aceca461c1cf15a182b3c: 2023-02-11 19:55:40,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/be6df0e03b8f48a2aa1ec56a953cc6f3 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__6nl316frb15ruibh9vst2mnus820i53vcjtbaudhsicc4kargsqgs004st3071lr/family1/be6df0e03b8f48a2aa1ec56a953cc6f3 2023-02-11 19:55:40,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/a41185cff4554c6783f24eb4276426e7 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__11oe4273f0puvmcjqidtvelt0g76g2jrkm62krepj1r8vf6qjlcfad384nbrfgaj/family1/a41185cff4554c6783f24eb4276426e7 2023-02-11 19:55:40,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__6nl316frb15ruibh9vst2mnus820i53vcjtbaudhsicc4kargsqgs004st3071lr/family1/be6df0e03b8f48a2aa1ec56a953cc6f3 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/8d9ec09593c54ff6ba85d0c558611c9b_SeqId_29_ 2023-02-11 19:55:40,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__11oe4273f0puvmcjqidtvelt0g76g2jrkm62krepj1r8vf6qjlcfad384nbrfgaj/family1/a41185cff4554c6783f24eb4276426e7 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/3b53eda08d02489184760a970199b011_SeqId_29_ 2023-02-11 19:55:40,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__6nl316frb15ruibh9vst2mnus820i53vcjtbaudhsicc4kargsqgs004st3071lr/family1/be6df0e03b8f48a2aa1ec56a953cc6f3 into 0086a9a022be72d7afa868235730b454/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/8d9ec09593c54ff6ba85d0c558611c9b_SeqId_29_ - updating store file list. 2023-02-11 19:55:40,199 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__11oe4273f0puvmcjqidtvelt0g76g2jrkm62krepj1r8vf6qjlcfad384nbrfgaj/family1/a41185cff4554c6783f24eb4276426e7 into 41e9cd5e0c2aceca461c1cf15a182b3c/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/3b53eda08d02489184760a970199b011_SeqId_29_ - updating store file list. 2023-02-11 19:55:40,200 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/e50897a568934ef3a25eeea332456685 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-11 19:55:40,201 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/e50897a568934ef3a25eeea332456685}] 2023-02-11 19:55:40,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/8d9ec09593c54ff6ba85d0c558611c9b_SeqId_29_ into 0086a9a022be72d7afa868235730b454/family1 2023-02-11 19:55:40,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__6nl316frb15ruibh9vst2mnus820i53vcjtbaudhsicc4kargsqgs004st3071lr/family1/be6df0e03b8f48a2aa1ec56a953cc6f3 into 0086a9a022be72d7afa868235730b454/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/8d9ec09593c54ff6ba85d0c558611c9b_SeqId_29_) 2023-02-11 19:55:40,203 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/3b53eda08d02489184760a970199b011_SeqId_29_ into 41e9cd5e0c2aceca461c1cf15a182b3c/family1 2023-02-11 19:55:40,204 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__11oe4273f0puvmcjqidtvelt0g76g2jrkm62krepj1r8vf6qjlcfad384nbrfgaj/family1/a41185cff4554c6783f24eb4276426e7 into 41e9cd5e0c2aceca461c1cf15a182b3c/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/3b53eda08d02489184760a970199b011_SeqId_29_) 2023-02-11 19:55:40,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__11oe4273f0puvmcjqidtvelt0g76g2jrkm62krepj1r8vf6qjlcfad384nbrfgaj/family1/a41185cff4554c6783f24eb4276426e7 2023-02-11 19:55:40,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__6nl316frb15ruibh9vst2mnus820i53vcjtbaudhsicc4kargsqgs004st3071lr/family1/be6df0e03b8f48a2aa1ec56a953cc6f3 2023-02-11 19:55:40,204 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/e50897a568934ef3a25eeea332456685 for inclusion in 42f2c6a1e29ae18303d02e7977b355c5/family1 2023-02-11 19:55:40,207 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 19:55:40,207 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 19:55:40,207 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:40,207 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:40,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-11 19:55:40,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-11 19:55:40,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 42f2c6a1e29ae18303d02e7977b355c5: 2023-02-11 19:55:40,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/e50897a568934ef3a25eeea332456685 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__g71nm8ru95v5tff05c385isddsolstvpffsbejuau919upa5nejdmujeco83hvd1/family1/e50897a568934ef3a25eeea332456685 2023-02-11 19:55:40,216 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302114a43cb1a719b43a4a8cf8695d755a199 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302114a43cb1a719b43a4a8cf8695d755a199 2023-02-11 19:55:40,217 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021110b4444813bd45d3a803e3041d64b560 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021110b4444813bd45d3a803e3041d64b560 2023-02-11 19:55:40,217 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021153c57c1a385f456c93a75031416c9cdb to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021153c57c1a385f456c93a75031416c9cdb 2023-02-11 19:55:40,220 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211514eda33fdee499e8032350fce2d0ea3 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211514eda33fdee499e8032350fce2d0ea3 2023-02-11 19:55:40,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__g71nm8ru95v5tff05c385isddsolstvpffsbejuau919upa5nejdmujeco83hvd1/family1/e50897a568934ef3a25eeea332456685 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/012a90d0dc8d435c88550a2e285b03a1_SeqId_29_ 2023-02-11 19:55:40,220 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211f5280f8bfa5e498b9fa4d88fa42c0790 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211f5280f8bfa5e498b9fa4d88fa42c0790 2023-02-11 19:55:40,221 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__g71nm8ru95v5tff05c385isddsolstvpffsbejuau919upa5nejdmujeco83hvd1/family1/e50897a568934ef3a25eeea332456685 into 42f2c6a1e29ae18303d02e7977b355c5/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/012a90d0dc8d435c88550a2e285b03a1_SeqId_29_ - updating store file list. 2023-02-11 19:55:40,221 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302116efc758a310747efacf0581ad538aff3 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302116efc758a310747efacf0581ad538aff3 2023-02-11 19:55:40,222 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211f6bf7a03f7364e4a8299590d74dc142c to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211f6bf7a03f7364e4a8299590d74dc142c 2023-02-11 19:55:40,222 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-11 19:55:40,222 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211' 2023-02-11 19:55:40,223 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211ac9d31f8f27f4b52a4141b5fd535e2ea to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211ac9d31f8f27f4b52a4141b5fd535e2ea 2023-02-11 19:55:40,223 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 19:55:40,223 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-11 19:55:40,223 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211' 2023-02-11 19:55:40,224 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 19:55:40,224 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/012a90d0dc8d435c88550a2e285b03a1_SeqId_29_ into 42f2c6a1e29ae18303d02e7977b355c5/family1 2023-02-11 19:55:40,224 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__g71nm8ru95v5tff05c385isddsolstvpffsbejuau919upa5nejdmujeco83hvd1/family1/e50897a568934ef3a25eeea332456685 into 42f2c6a1e29ae18303d02e7977b355c5/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/012a90d0dc8d435c88550a2e285b03a1_SeqId_29_) 2023-02-11 19:55:40,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__g71nm8ru95v5tff05c385isddsolstvpffsbejuau919upa5nejdmujeco83hvd1/family1/e50897a568934ef3a25eeea332456685 2023-02-11 19:55:40,226 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 19:55:40,227 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:40,228 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302111bd25a41a8d742bcbc6215d6214e492e to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302111bd25a41a8d742bcbc6215d6214e492e 2023-02-11 19:55:40,228 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302111cf551d1e927405d8ca52c8c3eaac980 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302111cf551d1e927405d8ca52c8c3eaac980 2023-02-11 19:55:40,229 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302114f663333d194492bb06e1f50277ae654 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302114f663333d194492bb06e1f50277ae654 2023-02-11 19:55:40,230 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302117e5fff121ed14e208d0cd837517a9824 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302117e5fff121ed14e208d0cd837517a9824 2023-02-11 19:55:40,230 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-11 19:55:40,230 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211' 2023-02-11 19:55:40,230 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 19:55:40,230 INFO [Listener at localhost/32929] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-11 19:55:40,230 INFO [Listener at localhost/32929] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 19:55:40,230 INFO [Listener at localhost/32929] compactions.PartitionedMobCompactor(367): [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302113baf570bfe1b4dc986cac0883bf8c82a_del] 2023-02-11 19:55:40,231 DEBUG [Listener at localhost/32929] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:40,232 DEBUG [Listener at localhost/32929] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302113baf570bfe1b4dc986cac0883bf8c82a_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302113baf570bfe1b4dc986cac0883bf8c82a_del 2023-02-11 19:55:40,232 INFO [Listener at localhost/32929] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-11 19:55:40,232 INFO [Listener at localhost/32929] compactions.PartitionedMobCompactor(367): [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302115c39ac27b75b44f3aa3c354ccfbbb515_del] 2023-02-11 19:55:40,232 DEBUG [Listener at localhost/32929] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:40,233 DEBUG [Listener at localhost/32929] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302115c39ac27b75b44f3aa3c354ccfbbb515_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302115c39ac27b75b44f3aa3c354ccfbbb515_del 2023-02-11 19:55:40,233 INFO [Listener at localhost/32929] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-11 19:55:40,233 INFO [Listener at localhost/32929] compactions.PartitionedMobCompactor(367): [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211af1cb33445e74a24b9154588ddcb185c_del] 2023-02-11 19:55:40,234 DEBUG [Listener at localhost/32929] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:40,235 DEBUG [Listener at localhost/32929] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211af1cb33445e74a24b9154588ddcb185c_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211af1cb33445e74a24b9154588ddcb185c_del 2023-02-11 19:55:40,235 INFO [Listener at localhost/32929] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-11 19:55:40,238 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 19:55:40,240 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 19:55:40,243 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 19:55:40,243 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 19:55:40,248 INFO [Listener at localhost/32929] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-02-11 19:55:40,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-02-11 19:55:40,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-02-11 19:55:40,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-11 19:55:40,251 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145340251"}]},"ts":"1676145340251"} 2023-02-11 19:55:40,253 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-02-11 19:55:40,254 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-02-11 19:55:40,255 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0086a9a022be72d7afa868235730b454, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=41e9cd5e0c2aceca461c1cf15a182b3c, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=42f2c6a1e29ae18303d02e7977b355c5, UNASSIGN}] 2023-02-11 19:55:40,256 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=41e9cd5e0c2aceca461c1cf15a182b3c, UNASSIGN 2023-02-11 19:55:40,256 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=42f2c6a1e29ae18303d02e7977b355c5, UNASSIGN 2023-02-11 19:55:40,256 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0086a9a022be72d7afa868235730b454, UNASSIGN 2023-02-11 19:55:40,257 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=41e9cd5e0c2aceca461c1cf15a182b3c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:40,257 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=0086a9a022be72d7afa868235730b454, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:40,257 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=42f2c6a1e29ae18303d02e7977b355c5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:40,257 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676145340257"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145340257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145340257"}]},"ts":"1676145340257"} 2023-02-11 19:55:40,257 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676145340257"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145340257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145340257"}]},"ts":"1676145340257"} 2023-02-11 19:55:40,257 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676145340257"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145340257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145340257"}]},"ts":"1676145340257"} 2023-02-11 19:55:40,258 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure 41e9cd5e0c2aceca461c1cf15a182b3c, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:55:40,258 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure 0086a9a022be72d7afa868235730b454, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:55:40,259 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure 42f2c6a1e29ae18303d02e7977b355c5, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:55:40,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-11 19:55:40,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 42f2c6a1e29ae18303d02e7977b355c5 2023-02-11 19:55:40,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 42f2c6a1e29ae18303d02e7977b355c5, disabling compactions & flushes 2023-02-11 19:55:40,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:40,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:40,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. after waiting 0 ms 2023-02-11 19:55:40,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:40,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-11 19:55:40,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:40,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 42f2c6a1e29ae18303d02e7977b355c5: Waiting for close lock at 1676145340410Running coprocessor pre-close hooks at 1676145340410Disabling compacts and flushes for region at 1676145340410Disabling writes for close at 1676145340410Writing region close event to WAL at 1676145340412 (+2 ms)Running coprocessor post-close hooks at 1676145340415 (+3 ms)Closed at 1676145340416 (+1 ms) 2023-02-11 19:55:40,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 42f2c6a1e29ae18303d02e7977b355c5 2023-02-11 19:55:40,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 41e9cd5e0c2aceca461c1cf15a182b3c 2023-02-11 19:55:40,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 41e9cd5e0c2aceca461c1cf15a182b3c, disabling compactions & flushes 2023-02-11 19:55:40,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:40,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:40,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. after waiting 0 ms 2023-02-11 19:55:40,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:40,418 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=42f2c6a1e29ae18303d02e7977b355c5, regionState=CLOSED 2023-02-11 19:55:40,418 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676145340418"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145340418"}]},"ts":"1676145340418"} 2023-02-11 19:55:40,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-02-11 19:55:40,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure 42f2c6a1e29ae18303d02e7977b355c5, server=jenkins-hbase4.apache.org,45897,1676145215747 in 160 msec 2023-02-11 19:55:40,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-11 19:55:40,422 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=42f2c6a1e29ae18303d02e7977b355c5, UNASSIGN in 166 msec 2023-02-11 19:55:40,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:40,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 41e9cd5e0c2aceca461c1cf15a182b3c: Waiting for close lock at 1676145340418Running coprocessor pre-close hooks at 1676145340418Disabling compacts and flushes for region at 1676145340418Disabling writes for close at 1676145340418Writing region close event to WAL at 1676145340419 (+1 ms)Running coprocessor post-close hooks at 1676145340422 (+3 ms)Closed at 1676145340423 (+1 ms) 2023-02-11 19:55:40,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 41e9cd5e0c2aceca461c1cf15a182b3c 2023-02-11 19:55:40,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0086a9a022be72d7afa868235730b454 2023-02-11 19:55:40,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0086a9a022be72d7afa868235730b454, disabling compactions & flushes 2023-02-11 19:55:40,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:40,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:40,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. after waiting 0 ms 2023-02-11 19:55:40,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:40,425 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=41e9cd5e0c2aceca461c1cf15a182b3c, regionState=CLOSED 2023-02-11 19:55:40,425 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676145340425"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145340425"}]},"ts":"1676145340425"} 2023-02-11 19:55:40,427 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-02-11 19:55:40,427 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure 41e9cd5e0c2aceca461c1cf15a182b3c, server=jenkins-hbase4.apache.org,45897,1676145215747 in 168 msec 2023-02-11 19:55:40,428 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=41e9cd5e0c2aceca461c1cf15a182b3c, UNASSIGN in 172 msec 2023-02-11 19:55:40,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-11 19:55:40,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:40,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0086a9a022be72d7afa868235730b454: Waiting for close lock at 1676145340424Running coprocessor pre-close hooks at 1676145340424Disabling compacts and flushes for region at 1676145340424Disabling writes for close at 1676145340425 (+1 ms)Writing region close event to WAL at 1676145340426 (+1 ms)Running coprocessor post-close hooks at 1676145340430 (+4 ms)Closed at 1676145340430 2023-02-11 19:55:40,431 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0086a9a022be72d7afa868235730b454 2023-02-11 19:55:40,432 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=0086a9a022be72d7afa868235730b454, regionState=CLOSED 2023-02-11 19:55:40,432 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676145340432"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145340432"}]},"ts":"1676145340432"} 2023-02-11 19:55:40,435 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=89 2023-02-11 19:55:40,435 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure 0086a9a022be72d7afa868235730b454, server=jenkins-hbase4.apache.org,45897,1676145215747 in 175 msec 2023-02-11 19:55:40,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=89, resume processing ppid=88 2023-02-11 19:55:40,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0086a9a022be72d7afa868235730b454, UNASSIGN in 180 msec 2023-02-11 19:55:40,437 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145340436"}]},"ts":"1676145340436"} 2023-02-11 19:55:40,438 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-02-11 19:55:40,439 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-02-11 19:55:40,440 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 191 msec 2023-02-11 19:55:40,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-11 19:55:40,554 INFO [Listener at localhost/32929] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-02-11 19:55:40,566 INFO [Listener at localhost/32929] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1676145326221-1676145340566 2023-02-11 19:55:40,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1676145326221-1676145340566 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-11 19:55:40,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676145340568 (current time:1676145340568). 2023-02-11 19:55:40,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 19:55:40,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] zookeeper.ReadOnlyZKClient(139): Connect 0x58a29b71 to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:55:40,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5775414b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:55:40,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:55:40,585 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34474, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:55:40,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58a29b71 to 127.0.0.1:64025 2023-02-11 19:55:40,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:55:40,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 19:55:40,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1676145326221-1676145340566 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-11 19:55:40,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-11 19:55:40,589 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-11 19:55:40,590 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1676145940590 2023-02-11 19:55:40,590 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1676145326221-1676145340566 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-11 19:55:40,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1676145326221-1676145340566 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-11 19:55:40,590 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1676145326221-1676145340566 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-11 19:55:40,590 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 19:55:40,691 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:55:40,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676145326221-1676145340566 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 19:55:40,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676145326221-1676145340566 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:55:40,692 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 19:55:40,892 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:55:40,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676145326221-1676145340566 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 19:55:40,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676145326221-1676145340566 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:55:40,894 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-11 19:55:41,000 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1676145326221-1676145340566 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-02-11 19:55:41,002 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-11 19:55:41,002 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-11 19:55:41,002 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-11 19:55:41,002 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-11 19:55:41,002 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-11 19:55:41,002 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-11 19:55:41,002 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-11 19:55:41,002 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-11 19:55:41,005 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/3b53eda08d02489184760a970199b011_SeqId_29_, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/fbe42987076a4825a9a3afdf648fc1d1] hfiles 2023-02-11 19:55:41,005 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/3b53eda08d02489184760a970199b011_SeqId_29_ 2023-02-11 19:55:41,005 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/8d9ec09593c54ff6ba85d0c558611c9b_SeqId_29_, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/d8d57f3e16864074803225facf777d6e] hfiles 2023-02-11 19:55:41,005 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/fbe42987076a4825a9a3afdf648fc1d1 2023-02-11 19:55:41,005 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/8d9ec09593c54ff6ba85d0c558611c9b_SeqId_29_ 2023-02-11 19:55:41,005 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/d8d57f3e16864074803225facf777d6e 2023-02-11 19:55:41,005 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/012a90d0dc8d435c88550a2e285b03a1_SeqId_29_, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/9961a0ef4c1948db99f48c79c04d2942] hfiles 2023-02-11 19:55:41,005 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/012a90d0dc8d435c88550a2e285b03a1_SeqId_29_ 2023-02-11 19:55:41,005 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302113243c08e41ac4df38e270d6771d5f958, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302114637f6d0588343928a521617e63d3ec4, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302118b06613aaf4f474d8122c99909c82445] hfiles 2023-02-11 19:55:41,005 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/9961a0ef4c1948db99f48c79c04d2942 2023-02-11 19:55:41,005 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302113243c08e41ac4df38e270d6771d5f958 2023-02-11 19:55:41,005 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302114637f6d0588343928a521617e63d3ec4 2023-02-11 19:55:41,005 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302118b06613aaf4f474d8122c99909c82445 2023-02-11 19:55:41,006 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/09d828aabc0b4bb5bec1531ab0ab3a61] hfiles 2023-02-11 19:55:41,006 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/09d828aabc0b4bb5bec1531ab0ab3a61 2023-02-11 19:55:41,006 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/28cbc6741be940c58b171b6dc0ffe945] hfiles 2023-02-11 19:55:41,006 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/28cbc6741be940c58b171b6dc0ffe945 2023-02-11 19:55:41,006 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/cfaa2a635a9441649c09fd301bdec55f] hfiles 2023-02-11 19:55:41,006 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/cfaa2a635a9441649c09fd301bdec55f 2023-02-11 19:55:41,011 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211197593bd71dc46bdb87b936d2dd523d9, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302112583ae85ca3f4e209ba30c623546266f, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302114bec32ec1cab4ec98feac8ebf325ce90, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211af44d94db61141229520baf48b9d02d5, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211eb8d2a87a22f42c1a38b939c5eb25623_del, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021135c31c98403e423fbecbf73a1ba02632, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211381a0202c80a415fbd9ffc363ca37484_del, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211422794b6235048f99246437e13f22796, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021166a6baee9c894709b7bc1002458cacbd, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211b0c8a4d24dcb4569a6268d1638945892, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302110521519962064bcaae6dfc38448f8981, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021148e6b54ffcf649c59ae03f59afa6e4af, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211b802cff8a4954dada1264037c81e4eb3, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211c56ff3894d65492e8d843700f5e6a463_del, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211e5d183efc4bd43fca45ccab8870cc052] hfiles 2023-02-11 19:55:41,011 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211197593bd71dc46bdb87b936d2dd523d9 2023-02-11 19:55:41,011 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302112583ae85ca3f4e209ba30c623546266f 2023-02-11 19:55:41,012 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302114bec32ec1cab4ec98feac8ebf325ce90 2023-02-11 19:55:41,012 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211af44d94db61141229520baf48b9d02d5 2023-02-11 19:55:41,012 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211eb8d2a87a22f42c1a38b939c5eb25623_del 2023-02-11 19:55:41,012 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021135c31c98403e423fbecbf73a1ba02632 2023-02-11 19:55:41,012 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211381a0202c80a415fbd9ffc363ca37484_del 2023-02-11 19:55:41,012 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211422794b6235048f99246437e13f22796 2023-02-11 19:55:41,012 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021166a6baee9c894709b7bc1002458cacbd 2023-02-11 19:55:41,012 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211b0c8a4d24dcb4569a6268d1638945892 2023-02-11 19:55:41,012 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302110521519962064bcaae6dfc38448f8981 2023-02-11 19:55:41,012 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021148e6b54ffcf649c59ae03f59afa6e4af 2023-02-11 19:55:41,012 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211b802cff8a4954dada1264037c81e4eb3 2023-02-11 19:55:41,012 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211c56ff3894d65492e8d843700f5e6a463_del 2023-02-11 19:55:41,012 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211e5d183efc4bd43fca45ccab8870cc052 2023-02-11 19:55:41,194 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:55:41,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676145326221-1676145340566 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 19:55:41,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676145326221-1676145340566 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:55:41,195 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-11 19:55:41,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1676145326221-1676145340566 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-02-11 19:55:41,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1676145326221-1676145340566 2023-02-11 19:55:41,417 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676145326221-1676145340566 2023-02-11 19:55:41,695 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:55:41,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676145326221-1676145340566 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 19:55:41,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676145326221-1676145340566 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:55:41,696 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-11 19:55:41,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676145326221-1676145340566 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.hbase-snapshot/hbase-failsafe-snaptb-1676145326221-1676145340566 2023-02-11 19:55:42,652 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1676145326221-1676145340566 of table testCompactionWithHFileLink completed 2023-02-11 19:55:42,652 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676145326221-1676145340566 2023-02-11 19:55:42,652 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676145326221-1676145340566 2023-02-11 19:55:42,652 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1676145326221-1676145340566 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1676145340590Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1676145326221-1676145340566 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1676145341001 (+411 ms)Consolidate snapshot: hbase-failsafe-snaptb-1676145326221-1676145340566 at 1676145341416 (+415 ms)Loading Region manifests for hbase-failsafe-snaptb-1676145326221-1676145340566 at 1676145341416Writing data manifest for hbase-failsafe-snaptb-1676145326221-1676145340566 at 1676145341419 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1676145326221-1676145340566 at 1676145341824 (+405 ms)Snapshot hbase-failsafe-snaptb-1676145326221-1676145340566 of table testCompactionWithHFileLink completed at 1676145342652 (+828 ms) 2023-02-11 19:55:42,653 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-11 19:55:42,655 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 2.0650 sec 2023-02-11 19:55:42,696 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:55:42,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676145326221-1676145340566 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 19:55:42,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1676145326221-1676145340566 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 19:55:42,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1676145326221" table: "testCompactionWithHFileLink" creation_time: 1676145326231 type: FLUSH version: 2 ttl: 0 ) 2023-02-11 19:55:42,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1676145326221 as table=testCompactionWithHFileLink 2023-02-11 19:55:42,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-11 19:55:42,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-11 19:55:43,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-11 19:55:43,146 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-11 19:55:43,146 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-11 19:55:43,147 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-11 19:55:43,147 INFO [PEWorker-3] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1676145326221 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-11 19:55:43,152 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1676145326221" table: "testCompactionWithHFileLink" creation_time: 1676145326231 type: FLUSH version: 2 ttl: 0 2023-02-11 19:55:43,153 DEBUG [PEWorker-3] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink 2023-02-11 19:55:43,158 DEBUG [PEWorker-3] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-02-11 19:55:43,162 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302114637f6d0588343928a521617e63d3ec4 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302114637f6d0588343928a521617e63d3ec4 2023-02-11 19:55:43,164 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302113243c08e41ac4df38e270d6771d5f958 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302113243c08e41ac4df38e270d6771d5f958 2023-02-11 19:55:43,166 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302118b06613aaf4f474d8122c99909c82445 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302118b06613aaf4f474d8122c99909c82445 2023-02-11 19:55:43,166 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023021110b4444813bd45d3a803e3041d64b560 of snapshot=snaptb-1676145326221 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 19:55:43,170 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230211514eda33fdee499e8032350fce2d0ea3 of snapshot=snaptb-1676145326221 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 19:55:43,173 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202302116efc758a310747efacf0581ad538aff3 of snapshot=snaptb-1676145326221 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 19:55:43,176 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230211ac9d31f8f27f4b52a4141b5fd535e2ea of snapshot=snaptb-1676145326221 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 19:55:43,185 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202302111bd25a41a8d742bcbc6215d6214e492e of snapshot=snaptb-1676145326221 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 19:55:43,189 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202302111cf551d1e927405d8ca52c8c3eaac980 of snapshot=snaptb-1676145326221 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 19:55:43,193 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202302114f663333d194492bb06e1f50277ae654 of snapshot=snaptb-1676145326221 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 19:55:43,197 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202302117e5fff121ed14e208d0cd837517a9824 of snapshot=snaptb-1676145326221 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 19:55:43,202 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202302114a43cb1a719b43a4a8cf8695d755a199 of snapshot=snaptb-1676145326221 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 19:55:43,205 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023021153c57c1a385f456c93a75031416c9cdb of snapshot=snaptb-1676145326221 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 19:55:43,211 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230211f5280f8bfa5e498b9fa4d88fa42c0790 of snapshot=snaptb-1676145326221 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 19:55:43,214 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230211f6bf7a03f7364e4a8299590d74dc142c of snapshot=snaptb-1676145326221 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 19:55:43,232 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211eb8d2a87a22f42c1a38b939c5eb25623_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211eb8d2a87a22f42c1a38b939c5eb25623_del 2023-02-11 19:55:43,234 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211c56ff3894d65492e8d843700f5e6a463_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211c56ff3894d65492e8d843700f5e6a463_del 2023-02-11 19:55:43,236 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211381a0202c80a415fbd9ffc363ca37484_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211381a0202c80a415fbd9ffc363ca37484_del 2023-02-11 19:55:43,236 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: 0086a9a022be72d7afa868235730b454 2023-02-11 19:55:43,236 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: 41e9cd5e0c2aceca461c1cf15a182b3c 2023-02-11 19:55:43,236 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: 42f2c6a1e29ae18303d02e7977b355c5 2023-02-11 19:55:43,248 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/8d9ec09593c54ff6ba85d0c558611c9b_SeqId_29_ to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/8d9ec09593c54ff6ba85d0c558611c9b_SeqId_29_ 2023-02-11 19:55:43,249 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/012a90d0dc8d435c88550a2e285b03a1_SeqId_29_ to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/012a90d0dc8d435c88550a2e285b03a1_SeqId_29_ 2023-02-11 19:55:43,250 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/d8d57f3e16864074803225facf777d6e to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/d8d57f3e16864074803225facf777d6e 2023-02-11 19:55:43,250 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0043e881679c4aafb4daf958eaca931b of snapshot=snaptb-1676145326221 to region=0086a9a022be72d7afa868235730b454 table=testCompactionWithHFileLink 2023-02-11 19:55:43,251 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/3b53eda08d02489184760a970199b011_SeqId_29_ to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/3b53eda08d02489184760a970199b011_SeqId_29_ 2023-02-11 19:55:43,251 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/9961a0ef4c1948db99f48c79c04d2942 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/9961a0ef4c1948db99f48c79c04d2942 2023-02-11 19:55:43,251 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 79aa122c58d142cdbb2e5673a05d98f5 of snapshot=snaptb-1676145326221 to region=42f2c6a1e29ae18303d02e7977b355c5 table=testCompactionWithHFileLink 2023-02-11 19:55:43,252 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/fbe42987076a4825a9a3afdf648fc1d1 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/fbe42987076a4825a9a3afdf648fc1d1 2023-02-11 19:55:43,252 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 62dedfe0ab4243159cc965af16601edc of snapshot=snaptb-1676145326221 to region=41e9cd5e0c2aceca461c1cf15a182b3c table=testCompactionWithHFileLink 2023-02-11 19:55:43,256 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8c27cc08c9ab4d6d9e67df97f16c94a5 of snapshot=snaptb-1676145326221 to region=0086a9a022be72d7afa868235730b454 table=testCompactionWithHFileLink 2023-02-11 19:55:43,259 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 616ddda77da84c3a837506544b7cb109 of snapshot=snaptb-1676145326221 to region=42f2c6a1e29ae18303d02e7977b355c5 table=testCompactionWithHFileLink 2023-02-11 19:55:43,260 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink df7b960c05ae42f895ac9013faf06841 of snapshot=snaptb-1676145326221 to region=41e9cd5e0c2aceca461c1cf15a182b3c table=testCompactionWithHFileLink 2023-02-11 19:55:43,264 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b4986457dac84dfebca8accc078c2389 of snapshot=snaptb-1676145326221 to region=0086a9a022be72d7afa868235730b454 table=testCompactionWithHFileLink 2023-02-11 19:55:43,270 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3533a49f68aa47c793072c555eced063 of snapshot=snaptb-1676145326221 to region=42f2c6a1e29ae18303d02e7977b355c5 table=testCompactionWithHFileLink 2023-02-11 19:55:43,271 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ca381d4e2fb14218b51cb252f8c11562 of snapshot=snaptb-1676145326221 to region=41e9cd5e0c2aceca461c1cf15a182b3c table=testCompactionWithHFileLink 2023-02-11 19:55:43,274 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cea5ccdcd7a845eba63ea3a33fd78e36 of snapshot=snaptb-1676145326221 to region=0086a9a022be72d7afa868235730b454 table=testCompactionWithHFileLink 2023-02-11 19:55:43,289 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9ceb0ccd412f4f0d9ac61b6ad8f07f73 of snapshot=snaptb-1676145326221 to region=42f2c6a1e29ae18303d02e7977b355c5 table=testCompactionWithHFileLink 2023-02-11 19:55:43,291 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 817c372a31c64a729c128640168c3f2a of snapshot=snaptb-1676145326221 to region=41e9cd5e0c2aceca461c1cf15a182b3c table=testCompactionWithHFileLink 2023-02-11 19:55:43,293 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/28cbc6741be940c58b171b6dc0ffe945 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/28cbc6741be940c58b171b6dc0ffe945 2023-02-11 19:55:43,293 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 10dfe7d4feb94f329cd6f96056c69c63 of snapshot=snaptb-1676145326221 to region=0086a9a022be72d7afa868235730b454 table=testCompactionWithHFileLink 2023-02-11 19:55:43,308 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 08d5567e077741848dbd58da76b14e91 of snapshot=snaptb-1676145326221 to region=0086a9a022be72d7afa868235730b454 table=testCompactionWithHFileLink 2023-02-11 19:55:43,308 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/09d828aabc0b4bb5bec1531ab0ab3a61 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/09d828aabc0b4bb5bec1531ab0ab3a61 2023-02-11 19:55:43,308 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 97eef38102724ed2b51e73049cb17d47 of snapshot=snaptb-1676145326221 to region=41e9cd5e0c2aceca461c1cf15a182b3c table=testCompactionWithHFileLink 2023-02-11 19:55:43,311 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/cfaa2a635a9441649c09fd301bdec55f to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/cfaa2a635a9441649c09fd301bdec55f 2023-02-11 19:55:43,311 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b9364ca0030f4bfe9f7a345dc3efb560 of snapshot=snaptb-1676145326221 to region=42f2c6a1e29ae18303d02e7977b355c5 table=testCompactionWithHFileLink 2023-02-11 19:55:43,312 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8a5a90da6ec842cb8b44d6b14cf6d9f0 of snapshot=snaptb-1676145326221 to region=41e9cd5e0c2aceca461c1cf15a182b3c table=testCompactionWithHFileLink 2023-02-11 19:55:43,312 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink df4dd57fefc6452a9613eca356e0e6bf of snapshot=snaptb-1676145326221 to region=0086a9a022be72d7afa868235730b454 table=testCompactionWithHFileLink 2023-02-11 19:55:43,316 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c5e29be64d8f4e40b0536b4a879e39a8 of snapshot=snaptb-1676145326221 to region=42f2c6a1e29ae18303d02e7977b355c5 table=testCompactionWithHFileLink 2023-02-11 19:55:43,316 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5110c81cf90a4b1f9698c8270d2ed018 of snapshot=snaptb-1676145326221 to region=41e9cd5e0c2aceca461c1cf15a182b3c table=testCompactionWithHFileLink 2023-02-11 19:55:43,316 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f6829a954d6e44609741440a3acfc4a7 of snapshot=snaptb-1676145326221 to region=0086a9a022be72d7afa868235730b454 table=testCompactionWithHFileLink 2023-02-11 19:55:43,320 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1545ab26592045bca34bf17dc9efd3d6 of snapshot=snaptb-1676145326221 to region=42f2c6a1e29ae18303d02e7977b355c5 table=testCompactionWithHFileLink 2023-02-11 19:55:43,320 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1a8baca107dc4039b450d62d971f2a85 of snapshot=snaptb-1676145326221 to region=41e9cd5e0c2aceca461c1cf15a182b3c table=testCompactionWithHFileLink 2023-02-11 19:55:43,323 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c274a0499f9c4b50a03fd9f9868b0a5b of snapshot=snaptb-1676145326221 to region=42f2c6a1e29ae18303d02e7977b355c5 table=testCompactionWithHFileLink 2023-02-11 19:55:43,327 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1676145326221" table: "testCompactionWithHFileLink" creation_time: 1676145326231 type: FLUSH version: 2 ttl: 0 2023-02-11 19:55:43,328 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676145343328"}]},"ts":"9223372036854775807"} 2023-02-11 19:55:43,328 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676145343328"}]},"ts":"9223372036854775807"} 2023-02-11 19:55:43,328 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676145343328"}]},"ts":"9223372036854775807"} 2023-02-11 19:55:43,330 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-02-11 19:55:43,330 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0086a9a022be72d7afa868235730b454, NAME => 'testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 41e9cd5e0c2aceca461c1cf15a182b3c, NAME => 'testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 42f2c6a1e29ae18303d02e7977b355c5, NAME => 'testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5.', STARTKEY => '2', ENDKEY => ''}] 2023-02-11 19:55:43,330 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676145343329"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145343329"}]},"ts":"1676145343329"} 2023-02-11 19:55:43,330 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676145343329"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145343329"}]},"ts":"1676145343329"} 2023-02-11 19:55:43,330 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676145343329"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145343329"}]},"ts":"1676145343329"} 2023-02-11 19:55:43,332 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-11 19:55:43,332 INFO [PEWorker-3] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-02-11 19:55:43,332 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 0086a9a022be72d7afa868235730b454, NAME => 'testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 41e9cd5e0c2aceca461c1cf15a182b3c, NAME => 'testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 42f2c6a1e29ae18303d02e7977b355c5, NAME => 'testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5.', STARTKEY => '2', ENDKEY => ''}] 2023-02-11 19:55:43,333 INFO [PEWorker-3] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1676145326221 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-02-11 19:55:43,335 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1676145326221" table: "testCompactionWithHFileLink" creation_time: 1676145326231 type: FLUSH version: 2 ttl: 0 ) in 607 msec 2023-02-11 19:55:43,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-11 19:55:43,342 INFO [Listener at localhost/32929] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-02-11 19:55:43,342 INFO [Listener at localhost/32929] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1676145326221-1676145340566 2023-02-11 19:55:43,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1676145326221-1676145340566" 2023-02-11 19:55:43,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1676145326221-1676145340566 2023-02-11 19:55:43,352 INFO [Listener at localhost/32929] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-02-11 19:55:43,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.HMaster$10(2372): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-02-11 19:55:43,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-02-11 19:55:43,367 INFO [PEWorker-5] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-02-11 19:55:43,367 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145343367"}]},"ts":"1676145343367"} 2023-02-11 19:55:43,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-11 19:55:43,368 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-11 19:55:43,371 DEBUG [PEWorker-5] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-02-11 19:55:43,371 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0086a9a022be72d7afa868235730b454, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=41e9cd5e0c2aceca461c1cf15a182b3c, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=42f2c6a1e29ae18303d02e7977b355c5, ASSIGN}] 2023-02-11 19:55:43,373 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=41e9cd5e0c2aceca461c1cf15a182b3c, ASSIGN 2023-02-11 19:55:43,373 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=42f2c6a1e29ae18303d02e7977b355c5, ASSIGN 2023-02-11 19:55:43,373 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0086a9a022be72d7afa868235730b454, ASSIGN 2023-02-11 19:55:43,373 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=41e9cd5e0c2aceca461c1cf15a182b3c, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-11 19:55:43,373 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=42f2c6a1e29ae18303d02e7977b355c5, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-11 19:55:43,373 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0086a9a022be72d7afa868235730b454, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-11 19:55:43,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-11 19:55:43,525 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=41e9cd5e0c2aceca461c1cf15a182b3c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:43,525 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=42f2c6a1e29ae18303d02e7977b355c5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:43,525 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676145343525"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145343525"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145343525"}]},"ts":"1676145343525"} 2023-02-11 19:55:43,525 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=0086a9a022be72d7afa868235730b454, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:43,525 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676145343525"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145343525"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145343525"}]},"ts":"1676145343525"} 2023-02-11 19:55:43,525 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676145343525"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145343525"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145343525"}]},"ts":"1676145343525"} 2023-02-11 19:55:43,527 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=99, state=RUNNABLE; OpenRegionProcedure 41e9cd5e0c2aceca461c1cf15a182b3c, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:55:43,527 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; OpenRegionProcedure 42f2c6a1e29ae18303d02e7977b355c5, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:55:43,528 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure 0086a9a022be72d7afa868235730b454, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:55:43,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-11 19:55:43,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:43,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0086a9a022be72d7afa868235730b454, NAME => 'testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454.', STARTKEY => '', ENDKEY => '1'} 2023-02-11 19:55:43,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 0086a9a022be72d7afa868235730b454 2023-02-11 19:55:43,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:55:43,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0086a9a022be72d7afa868235730b454 2023-02-11 19:55:43,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0086a9a022be72d7afa868235730b454 2023-02-11 19:55:43,682 INFO [StoreOpener-0086a9a022be72d7afa868235730b454-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0086a9a022be72d7afa868235730b454 2023-02-11 19:55:43,683 DEBUG [StoreOpener-0086a9a022be72d7afa868235730b454-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1 2023-02-11 19:55:43,683 DEBUG [StoreOpener-0086a9a022be72d7afa868235730b454-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1 2023-02-11 19:55:43,684 INFO [StoreOpener-0086a9a022be72d7afa868235730b454-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0086a9a022be72d7afa868235730b454 columnFamilyName family1 2023-02-11 19:55:43,700 DEBUG [StoreOpener-0086a9a022be72d7afa868235730b454-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-0043e881679c4aafb4daf958eaca931b 2023-02-11 19:55:43,705 DEBUG [StoreOpener-0086a9a022be72d7afa868235730b454-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-8c27cc08c9ab4d6d9e67df97f16c94a5 2023-02-11 19:55:43,711 DEBUG [StoreOpener-0086a9a022be72d7afa868235730b454-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-b4986457dac84dfebca8accc078c2389 2023-02-11 19:55:43,716 DEBUG [StoreOpener-0086a9a022be72d7afa868235730b454-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-cea5ccdcd7a845eba63ea3a33fd78e36 2023-02-11 19:55:43,717 INFO [StoreOpener-0086a9a022be72d7afa868235730b454-1] regionserver.HStore(310): Store=0086a9a022be72d7afa868235730b454/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:55:43,717 INFO [StoreOpener-0086a9a022be72d7afa868235730b454-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0086a9a022be72d7afa868235730b454 2023-02-11 19:55:43,718 DEBUG [StoreOpener-0086a9a022be72d7afa868235730b454-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2 2023-02-11 19:55:43,718 DEBUG [StoreOpener-0086a9a022be72d7afa868235730b454-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2 2023-02-11 19:55:43,718 INFO [StoreOpener-0086a9a022be72d7afa868235730b454-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0086a9a022be72d7afa868235730b454 columnFamilyName family2 2023-02-11 19:55:43,726 DEBUG [StoreOpener-0086a9a022be72d7afa868235730b454-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-08d5567e077741848dbd58da76b14e91 2023-02-11 19:55:43,733 DEBUG [StoreOpener-0086a9a022be72d7afa868235730b454-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-10dfe7d4feb94f329cd6f96056c69c63 2023-02-11 19:55:43,739 DEBUG [StoreOpener-0086a9a022be72d7afa868235730b454-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-df4dd57fefc6452a9613eca356e0e6bf 2023-02-11 19:55:43,745 DEBUG [StoreOpener-0086a9a022be72d7afa868235730b454-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-f6829a954d6e44609741440a3acfc4a7 2023-02-11 19:55:43,746 INFO [StoreOpener-0086a9a022be72d7afa868235730b454-1] regionserver.HStore(310): Store=0086a9a022be72d7afa868235730b454/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:55:43,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454 2023-02-11 19:55:43,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454 2023-02-11 19:55:43,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:55:43,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0086a9a022be72d7afa868235730b454 2023-02-11 19:55:43,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0086a9a022be72d7afa868235730b454; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60939637, jitterRate=-0.0919286459684372}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:55:43,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0086a9a022be72d7afa868235730b454: Running coprocessor pre-open hook at 1676145343681Writing region info on filesystem at 1676145343681Initializing all the Stores at 1676145343682 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145343682Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145343682Cleaning up temporary data from old regions at 1676145343749 (+67 ms)Cleaning up detritus from prior splits at 1676145343749Running coprocessor post-open hooks at 1676145343752 (+3 ms)Region opened successfully at 1676145343752 2023-02-11 19:55:43,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454., pid=103, masterSystemTime=1676145343678 2023-02-11 19:55:43,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:55:43,754 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-11 19:55:43,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-11 19:55:43,754 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-11 19:55:43,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:43,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:43,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:43,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 42f2c6a1e29ae18303d02e7977b355c5, NAME => 'testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5.', STARTKEY => '2', ENDKEY => ''} 2023-02-11 19:55:43,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 42f2c6a1e29ae18303d02e7977b355c5 2023-02-11 19:55:43,756 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=0086a9a022be72d7afa868235730b454, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:43,756 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676145343755"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145343755"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145343755"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145343755"}]},"ts":"1676145343755"} 2023-02-11 19:55:43,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:55:43,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 42f2c6a1e29ae18303d02e7977b355c5 2023-02-11 19:55:43,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 42f2c6a1e29ae18303d02e7977b355c5 2023-02-11 19:55:43,758 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-11 19:55:43,758 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1912): 0086a9a022be72d7afa868235730b454/family1 is initiating minor compaction (all files) 2023-02-11 19:55:43,759 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 0086a9a022be72d7afa868235730b454/family1 in testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:43,759 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-0043e881679c4aafb4daf958eaca931b, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-8c27cc08c9ab4d6d9e67df97f16c94a5, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-b4986457dac84dfebca8accc078c2389, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-cea5ccdcd7a845eba63ea3a33fd78e36] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp, totalSize=21.6 K 2023-02-11 19:55:43,759 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-11 19:55:43,759 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=98 2023-02-11 19:55:43,759 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] regionserver.HStore(1912): 0086a9a022be72d7afa868235730b454/family2 is initiating minor compaction (all files) 2023-02-11 19:55:43,759 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-0043e881679c4aafb4daf958eaca931b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145319465 2023-02-11 19:55:43,759 INFO [RS:0;jenkins-hbase4:45897-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 0086a9a022be72d7afa868235730b454/family2 in testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:55:43,760 INFO [RS:0;jenkins-hbase4:45897-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-10dfe7d4feb94f329cd6f96056c69c63, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-08d5567e077741848dbd58da76b14e91, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-df4dd57fefc6452a9613eca356e0e6bf, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-f6829a954d6e44609741440a3acfc4a7] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp, totalSize=20.4 K 2023-02-11 19:55:43,759 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure 0086a9a022be72d7afa868235730b454, server=jenkins-hbase4.apache.org,45897,1676145215747 in 229 msec 2023-02-11 19:55:43,760 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-8c27cc08c9ab4d6d9e67df97f16c94a5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145321251 2023-02-11 19:55:43,760 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-10dfe7d4feb94f329cd6f96056c69c63, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145319465 2023-02-11 19:55:43,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0086a9a022be72d7afa868235730b454, ASSIGN in 388 msec 2023-02-11 19:55:43,761 INFO [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 42f2c6a1e29ae18303d02e7977b355c5 2023-02-11 19:55:43,761 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-b4986457dac84dfebca8accc078c2389, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145323041 2023-02-11 19:55:43,761 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-08d5567e077741848dbd58da76b14e91, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145321251 2023-02-11 19:55:43,762 DEBUG [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1 2023-02-11 19:55:43,762 DEBUG [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1 2023-02-11 19:55:43,762 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-cea5ccdcd7a845eba63ea3a33fd78e36, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145324433 2023-02-11 19:55:43,762 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-df4dd57fefc6452a9613eca356e0e6bf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145323041 2023-02-11 19:55:43,763 INFO [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 42f2c6a1e29ae18303d02e7977b355c5 columnFamilyName family1 2023-02-11 19:55:43,764 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-f6829a954d6e44609741440a3acfc4a7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145324433 2023-02-11 19:55:43,783 DEBUG [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-3533a49f68aa47c793072c555eced063 2023-02-11 19:55:43,793 DEBUG [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-616ddda77da84c3a837506544b7cb109 2023-02-11 19:55:43,800 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0086a9a022be72d7afa868235730b454#family1#compaction#114 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-02-11 19:55:43,805 DEBUG [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-79aa122c58d142cdbb2e5673a05d98f5 2023-02-11 19:55:43,820 INFO [RS:0;jenkins-hbase4:45897-longCompactions-0] throttle.PressureAwareThroughputController(145): 0086a9a022be72d7afa868235730b454#family2#compaction#115 average throughput is 0.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-02-11 19:55:43,821 DEBUG [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-9ceb0ccd412f4f0d9ac61b6ad8f07f73 2023-02-11 19:55:43,821 INFO [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] regionserver.HStore(310): Store=42f2c6a1e29ae18303d02e7977b355c5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:55:43,821 INFO [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 42f2c6a1e29ae18303d02e7977b355c5 2023-02-11 19:55:43,822 DEBUG [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2 2023-02-11 19:55:43,822 DEBUG [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2 2023-02-11 19:55:43,823 INFO [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 42f2c6a1e29ae18303d02e7977b355c5 columnFamilyName family2 2023-02-11 19:55:43,830 DEBUG [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-1545ab26592045bca34bf17dc9efd3d6 2023-02-11 19:55:43,834 DEBUG [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-b9364ca0030f4bfe9f7a345dc3efb560 2023-02-11 19:55:43,838 DEBUG [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-c274a0499f9c4b50a03fd9f9868b0a5b 2023-02-11 19:55:43,843 DEBUG [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-c5e29be64d8f4e40b0536b4a879e39a8 2023-02-11 19:55:43,844 INFO [StoreOpener-42f2c6a1e29ae18303d02e7977b355c5-1] regionserver.HStore(310): Store=42f2c6a1e29ae18303d02e7977b355c5/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:55:43,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5 2023-02-11 19:55:43,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5 2023-02-11 19:55:43,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:55:43,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 42f2c6a1e29ae18303d02e7977b355c5 2023-02-11 19:55:43,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 42f2c6a1e29ae18303d02e7977b355c5; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72103074, jitterRate=0.0744195282459259}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:55:43,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 42f2c6a1e29ae18303d02e7977b355c5: Running coprocessor pre-open hook at 1676145343756Writing region info on filesystem at 1676145343756Initializing all the Stores at 1676145343758 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145343758Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145343759 (+1 ms)Cleaning up temporary data from old regions at 1676145343846 (+87 ms)Cleaning up detritus from prior splits at 1676145343846Running coprocessor post-open hooks at 1676145343849 (+3 ms)Region opened successfully at 1676145343849 2023-02-11 19:55:43,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5., pid=102, masterSystemTime=1676145343678 2023-02-11 19:55:43,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-11 19:55:43,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-11 19:55:43,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:43,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:43,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:43,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 41e9cd5e0c2aceca461c1cf15a182b3c, NAME => 'testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c.', STARTKEY => '1', ENDKEY => '2'} 2023-02-11 19:55:43,851 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=42f2c6a1e29ae18303d02e7977b355c5, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:43,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 41e9cd5e0c2aceca461c1cf15a182b3c 2023-02-11 19:55:43,851 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676145343851"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145343851"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145343851"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145343851"}]},"ts":"1676145343851"} 2023-02-11 19:55:43,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:55:43,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 41e9cd5e0c2aceca461c1cf15a182b3c 2023-02-11 19:55:43,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 41e9cd5e0c2aceca461c1cf15a182b3c 2023-02-11 19:55:43,853 INFO [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 41e9cd5e0c2aceca461c1cf15a182b3c 2023-02-11 19:55:43,854 DEBUG [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1 2023-02-11 19:55:43,854 DEBUG [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1 2023-02-11 19:55:43,854 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-02-11 19:55:43,854 INFO [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41e9cd5e0c2aceca461c1cf15a182b3c columnFamilyName family1 2023-02-11 19:55:43,854 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; OpenRegionProcedure 42f2c6a1e29ae18303d02e7977b355c5, server=jenkins-hbase4.apache.org,45897,1676145215747 in 325 msec 2023-02-11 19:55:43,855 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=42f2c6a1e29ae18303d02e7977b355c5, ASSIGN in 483 msec 2023-02-11 19:55:43,863 DEBUG [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-62dedfe0ab4243159cc965af16601edc 2023-02-11 19:55:43,870 DEBUG [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-817c372a31c64a729c128640168c3f2a 2023-02-11 19:55:43,878 DEBUG [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-ca381d4e2fb14218b51cb252f8c11562 2023-02-11 19:55:43,883 DEBUG [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-df7b960c05ae42f895ac9013faf06841 2023-02-11 19:55:43,883 INFO [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] regionserver.HStore(310): Store=41e9cd5e0c2aceca461c1cf15a182b3c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:55:43,883 INFO [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 41e9cd5e0c2aceca461c1cf15a182b3c 2023-02-11 19:55:43,884 DEBUG [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2 2023-02-11 19:55:43,884 DEBUG [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2 2023-02-11 19:55:43,884 INFO [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41e9cd5e0c2aceca461c1cf15a182b3c columnFamilyName family2 2023-02-11 19:55:43,891 DEBUG [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-1a8baca107dc4039b450d62d971f2a85 2023-02-11 19:55:43,897 DEBUG [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-5110c81cf90a4b1f9698c8270d2ed018 2023-02-11 19:55:43,903 DEBUG [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-8a5a90da6ec842cb8b44d6b14cf6d9f0 2023-02-11 19:55:43,908 DEBUG [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] regionserver.HStore(539): loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-97eef38102724ed2b51e73049cb17d47 2023-02-11 19:55:43,909 INFO [StoreOpener-41e9cd5e0c2aceca461c1cf15a182b3c-1] regionserver.HStore(310): Store=41e9cd5e0c2aceca461c1cf15a182b3c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:55:43,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c 2023-02-11 19:55:43,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c 2023-02-11 19:55:43,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:55:43,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 41e9cd5e0c2aceca461c1cf15a182b3c 2023-02-11 19:55:43,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 41e9cd5e0c2aceca461c1cf15a182b3c; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67564587, jitterRate=0.0067908018827438354}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:55:43,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 41e9cd5e0c2aceca461c1cf15a182b3c: Running coprocessor pre-open hook at 1676145343852Writing region info on filesystem at 1676145343852Initializing all the Stores at 1676145343852Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145343852Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145343852Cleaning up temporary data from old regions at 1676145343911 (+59 ms)Cleaning up detritus from prior splits at 1676145343911Running coprocessor post-open hooks at 1676145343913 (+2 ms)Region opened successfully at 1676145343914 (+1 ms) 2023-02-11 19:55:43,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c., pid=101, masterSystemTime=1676145343678 2023-02-11 19:55:43,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-11 19:55:43,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-11 19:55:43,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:43,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:43,916 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=41e9cd5e0c2aceca461c1cf15a182b3c, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:43,916 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676145343916"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145343916"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145343916"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145343916"}]},"ts":"1676145343916"} 2023-02-11 19:55:43,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-02-11 19:55:43,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; OpenRegionProcedure 41e9cd5e0c2aceca461c1cf15a182b3c, server=jenkins-hbase4.apache.org,45897,1676145215747 in 391 msec 2023-02-11 19:55:43,920 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=99, resume processing ppid=97 2023-02-11 19:55:43,921 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=41e9cd5e0c2aceca461c1cf15a182b3c, ASSIGN in 548 msec 2023-02-11 19:55:43,921 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145343921"}]},"ts":"1676145343921"} 2023-02-11 19:55:43,922 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-11 19:55:43,923 INFO [PEWorker-1] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-02-11 19:55:43,925 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 565 msec 2023-02-11 19:55:43,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-11 19:55:43,971 INFO [Listener at localhost/32929] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-02-11 19:55:43,984 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 19:55:43,992 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 19:55:44,001 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 19:55:44,002 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 19:55:44,008 INFO [Listener at localhost/32929] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-11 19:55:44,024 INFO [Listener at localhost/32929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-11 19:55:44,024 INFO [Listener at localhost/32929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-11 19:55:44,024 DEBUG [Listener at localhost/32929] zookeeper.ReadOnlyZKClient(139): Connect 0x32f4cb3b to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:55:44,029 DEBUG [Listener at localhost/32929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27841654, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:55:44,030 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 19:55:44,030 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 19:55:44,030 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 19:55:44,518 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211ca6b824a9ca540c9b5292254c2e81fcb to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211ca6b824a9ca540c9b5292254c2e81fcb 2023-02-11 19:55:44,519 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 19:55:44,531 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:55:44,534 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54122, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:55:44,540 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:55:44,542 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54554, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:55:44,551 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/cf5388e14eff4da5b8e35de0069c63c5 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-02-11 19:55:44,551 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/cf5388e14eff4da5b8e35de0069c63c5}] 2023-02-11 19:55:44,557 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/cf5388e14eff4da5b8e35de0069c63c5 for inclusion in 42f2c6a1e29ae18303d02e7977b355c5/family1 2023-02-11 19:55:44,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-02-11 19:55:44,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-11 19:55:44,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 42f2c6a1e29ae18303d02e7977b355c5: 2023-02-11 19:55:44,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/cf5388e14eff4da5b8e35de0069c63c5 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__j8pafpbbo3kpklla4v9ovqm9311vrt2ipnrvhggnod5rd066798msh57lq3frbig/family1/cf5388e14eff4da5b8e35de0069c63c5 2023-02-11 19:55:44,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__j8pafpbbo3kpklla4v9ovqm9311vrt2ipnrvhggnod5rd066798msh57lq3frbig/family1/cf5388e14eff4da5b8e35de0069c63c5 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/d5f090dd176741ef97795b1512a79780_SeqId_34_ 2023-02-11 19:55:44,563 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__j8pafpbbo3kpklla4v9ovqm9311vrt2ipnrvhggnod5rd066798msh57lq3frbig/family1/cf5388e14eff4da5b8e35de0069c63c5 into 42f2c6a1e29ae18303d02e7977b355c5/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/d5f090dd176741ef97795b1512a79780_SeqId_34_ - updating store file list. 2023-02-11 19:55:44,566 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/d5f090dd176741ef97795b1512a79780_SeqId_34_ into 42f2c6a1e29ae18303d02e7977b355c5/family1 2023-02-11 19:55:44,566 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__j8pafpbbo3kpklla4v9ovqm9311vrt2ipnrvhggnod5rd066798msh57lq3frbig/family1/cf5388e14eff4da5b8e35de0069c63c5 into 42f2c6a1e29ae18303d02e7977b355c5/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/d5f090dd176741ef97795b1512a79780_SeqId_34_) 2023-02-11 19:55:44,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__j8pafpbbo3kpklla4v9ovqm9311vrt2ipnrvhggnod5rd066798msh57lq3frbig/family1/cf5388e14eff4da5b8e35de0069c63c5 2023-02-11 19:55:44,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 19:55:44,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-11 19:55:44,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(1912): 42f2c6a1e29ae18303d02e7977b355c5/family1 is initiating minor compaction (all files) 2023-02-11 19:55:44,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3a599885; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-11 19:55:44,571 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 19:55:44,571 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:44,573 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302111bd25a41a8d742bcbc6215d6214e492e to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302111bd25a41a8d742bcbc6215d6214e492e 2023-02-11 19:55:44,573 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302111cf551d1e927405d8ca52c8c3eaac980 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302111cf551d1e927405d8ca52c8c3eaac980 2023-02-11 19:55:44,574 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302114f663333d194492bb06e1f50277ae654 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302114f663333d194492bb06e1f50277ae654 2023-02-11 19:55:44,575 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302117e5fff121ed14e208d0cd837517a9824 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302117e5fff121ed14e208d0cd837517a9824 2023-02-11 19:55:44,575 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-11 19:55:44,575 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211' 2023-02-11 19:55:44,575 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 19:55:44,632 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family1/0fd93e26395a4d3f90e343e08b339e9d as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/0fd93e26395a4d3f90e343e08b339e9d 2023-02-11 19:55:44,636 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-11 19:55:44,636 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 0086a9a022be72d7afa868235730b454/family1 of 0086a9a022be72d7afa868235730b454 into 0fd93e26395a4d3f90e343e08b339e9d(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 19:55:44,636 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 0086a9a022be72d7afa868235730b454: 2023-02-11 19:55:44,636 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454., storeName=0086a9a022be72d7afa868235730b454/family1, priority=12, startTime=1676145343753; duration=0sec 2023-02-11 19:55:44,636 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-11 19:55:44,636 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 42f2c6a1e29ae18303d02e7977b355c5/family1 in testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:44,636 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-79aa122c58d142cdbb2e5673a05d98f5, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-616ddda77da84c3a837506544b7cb109, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-3533a49f68aa47c793072c555eced063, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-9ceb0ccd412f4f0d9ac61b6ad8f07f73, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/d5f090dd176741ef97795b1512a79780_SeqId_34_] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp, totalSize=28.9 K 2023-02-11 19:55:44,637 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-79aa122c58d142cdbb2e5673a05d98f5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145319467 2023-02-11 19:55:44,638 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-616ddda77da84c3a837506544b7cb109, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145321251 2023-02-11 19:55:44,638 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-3533a49f68aa47c793072c555eced063, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145323042 2023-02-11 19:55:44,638 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-9ceb0ccd412f4f0d9ac61b6ad8f07f73, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145324434 2023-02-11 19:55:44,639 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting d5f090dd176741ef97795b1512a79780_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1676145319467 2023-02-11 19:55:44,652 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] throttle.PressureAwareThroughputController(145): 42f2c6a1e29ae18303d02e7977b355c5#family1#compaction#116 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-02-11 19:55:44,734 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-0043e881679c4aafb4daf958eaca931b, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-8c27cc08c9ab4d6d9e67df97f16c94a5, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-b4986457dac84dfebca8accc078c2389, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-cea5ccdcd7a845eba63ea3a33fd78e36] to archive 2023-02-11 19:55:44,734 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:44,736 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-0043e881679c4aafb4daf958eaca931b to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-0043e881679c4aafb4daf958eaca931b 2023-02-11 19:55:44,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-8c27cc08c9ab4d6d9e67df97f16c94a5 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-8c27cc08c9ab4d6d9e67df97f16c94a5 2023-02-11 19:55:44,738 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-b4986457dac84dfebca8accc078c2389 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-b4986457dac84dfebca8accc078c2389 2023-02-11 19:55:44,739 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-cea5ccdcd7a845eba63ea3a33fd78e36 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-cea5ccdcd7a845eba63ea3a33fd78e36 2023-02-11 19:55:44,914 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302117a6fbd4935074e7a90a6403fff4d331e to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302117a6fbd4935074e7a90a6403fff4d331e 2023-02-11 19:55:44,915 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 19:55:44,915 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211470186b3cfd045828c4666aa3f1ea1da to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211470186b3cfd045828c4666aa3f1ea1da 2023-02-11 19:55:44,916 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 19:55:44,944 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/4aab7530bc3949c8a3067dec10e70a99 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-02-11 19:55:44,944 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/38e56302a11341498bf97a34ac7172a7 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-02-11 19:55:44,945 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=32 for row with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/4aab7530bc3949c8a3067dec10e70a99}] 2023-02-11 19:55:44,945 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/38e56302a11341498bf97a34ac7172a7}] 2023-02-11 19:55:44,948 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/4aab7530bc3949c8a3067dec10e70a99 for inclusion in 0086a9a022be72d7afa868235730b454/family1 2023-02-11 19:55:44,948 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/38e56302a11341498bf97a34ac7172a7 for inclusion in 41e9cd5e0c2aceca461c1cf15a182b3c/family1 2023-02-11 19:55:44,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-02-11 19:55:44,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last=1 2023-02-11 19:55:44,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-02-11 19:55:44,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-11 19:55:44,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 0086a9a022be72d7afa868235730b454: 2023-02-11 19:55:44,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 41e9cd5e0c2aceca461c1cf15a182b3c: 2023-02-11 19:55:44,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/4aab7530bc3949c8a3067dec10e70a99 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__m662hhjjuk8qjdfpun4h1bpjj9qkijr6nofkqbdhniggrvgnu3vhiese1b9ifd5k/family1/4aab7530bc3949c8a3067dec10e70a99 2023-02-11 19:55:44,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/38e56302a11341498bf97a34ac7172a7 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__uqm2o5bv3tsl8qb584tvrvd18r7pg11voug8sebt4l03kqv9iori8pebhgbco8qf/family1/38e56302a11341498bf97a34ac7172a7 2023-02-11 19:55:44,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__m662hhjjuk8qjdfpun4h1bpjj9qkijr6nofkqbdhniggrvgnu3vhiese1b9ifd5k/family1/4aab7530bc3949c8a3067dec10e70a99 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/9af1d0c22d08401ba811cb3e611b7e7f_SeqId_35_ 2023-02-11 19:55:44,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__uqm2o5bv3tsl8qb584tvrvd18r7pg11voug8sebt4l03kqv9iori8pebhgbco8qf/family1/38e56302a11341498bf97a34ac7172a7 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/a8fcc2d4dff7476e9d7f469776b01285_SeqId_34_ 2023-02-11 19:55:44,954 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__m662hhjjuk8qjdfpun4h1bpjj9qkijr6nofkqbdhniggrvgnu3vhiese1b9ifd5k/family1/4aab7530bc3949c8a3067dec10e70a99 into 0086a9a022be72d7afa868235730b454/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/9af1d0c22d08401ba811cb3e611b7e7f_SeqId_35_ - updating store file list. 2023-02-11 19:55:44,954 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__uqm2o5bv3tsl8qb584tvrvd18r7pg11voug8sebt4l03kqv9iori8pebhgbco8qf/family1/38e56302a11341498bf97a34ac7172a7 into 41e9cd5e0c2aceca461c1cf15a182b3c/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/a8fcc2d4dff7476e9d7f469776b01285_SeqId_34_ - updating store file list. 2023-02-11 19:55:44,956 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/a8fcc2d4dff7476e9d7f469776b01285_SeqId_34_ into 41e9cd5e0c2aceca461c1cf15a182b3c/family1 2023-02-11 19:55:44,957 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__uqm2o5bv3tsl8qb584tvrvd18r7pg11voug8sebt4l03kqv9iori8pebhgbco8qf/family1/38e56302a11341498bf97a34ac7172a7 into 41e9cd5e0c2aceca461c1cf15a182b3c/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/a8fcc2d4dff7476e9d7f469776b01285_SeqId_34_) 2023-02-11 19:55:44,957 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/9af1d0c22d08401ba811cb3e611b7e7f_SeqId_35_ into 0086a9a022be72d7afa868235730b454/family1 2023-02-11 19:55:44,957 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__m662hhjjuk8qjdfpun4h1bpjj9qkijr6nofkqbdhniggrvgnu3vhiese1b9ifd5k/family1/4aab7530bc3949c8a3067dec10e70a99 into 0086a9a022be72d7afa868235730b454/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family1/9af1d0c22d08401ba811cb3e611b7e7f_SeqId_35_) 2023-02-11 19:55:44,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__uqm2o5bv3tsl8qb584tvrvd18r7pg11voug8sebt4l03kqv9iori8pebhgbco8qf/family1/38e56302a11341498bf97a34ac7172a7 2023-02-11 19:55:44,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testCompactionWithHFileLink__m662hhjjuk8qjdfpun4h1bpjj9qkijr6nofkqbdhniggrvgnu3vhiese1b9ifd5k/family1/4aab7530bc3949c8a3067dec10e70a99 2023-02-11 19:55:44,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 19:55:44,958 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 19:55:44,959 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:44,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-11 19:55:44,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(1912): 41e9cd5e0c2aceca461c1cf15a182b3c/family1 is initiating minor compaction (all files) 2023-02-11 19:55:44,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3efe3e5a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-11 19:55:44,960 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302114a43cb1a719b43a4a8cf8695d755a199 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302114a43cb1a719b43a4a8cf8695d755a199 2023-02-11 19:55:44,961 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 19:55:44,961 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023021153c57c1a385f456c93a75031416c9cdb to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023021153c57c1a385f456c93a75031416c9cdb 2023-02-11 19:55:44,962 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:44,963 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230211f5280f8bfa5e498b9fa4d88fa42c0790 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230211f5280f8bfa5e498b9fa4d88fa42c0790 2023-02-11 19:55:44,963 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023021110b4444813bd45d3a803e3041d64b560 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023021110b4444813bd45d3a803e3041d64b560 2023-02-11 19:55:44,964 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230211f6bf7a03f7364e4a8299590d74dc142c to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230211f6bf7a03f7364e4a8299590d74dc142c 2023-02-11 19:55:44,964 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-11 19:55:44,964 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211' 2023-02-11 19:55:44,964 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 19:55:44,964 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230211514eda33fdee499e8032350fce2d0ea3 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230211514eda33fdee499e8032350fce2d0ea3 2023-02-11 19:55:44,965 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302116efc758a310747efacf0581ad538aff3 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302116efc758a310747efacf0581ad538aff3 2023-02-11 19:55:44,966 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230211ac9d31f8f27f4b52a4141b5fd535e2ea to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230211ac9d31f8f27f4b52a4141b5fd535e2ea 2023-02-11 19:55:44,966 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-11 19:55:44,966 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211' 2023-02-11 19:55:44,966 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 19:55:44,966 INFO [Listener at localhost/32929] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-11 19:55:44,970 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 19:55:44,971 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 19:55:44,974 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 19:55:44,975 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 19:55:44,980 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 19:55:44,981 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 19:55:44,996 INFO [Listener at localhost/32929] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=286 (was 242) - Thread LEAK? -, OpenFileDescriptor=764 (was 608) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=135 (was 184), ProcessCount=168 (was 168), AvailableMemoryMB=3420 (was 3564) 2023-02-11 19:55:45,009 INFO [Listener at localhost/32929] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=286, OpenFileDescriptor=764, MaxFileDescriptor=60000, SystemLoadAverage=135, ProcessCount=168, AvailableMemoryMB=3419 2023-02-11 19:55:45,015 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.HMaster$15(2997): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-02-11 19:55:45,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-02-11 19:55:45,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-11 19:55:45,022 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:55:45,024 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 8 msec 2023-02-11 19:55:45,037 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/.tmp/family2/a164b364059b4fa5a3a51789c91c449f as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/a164b364059b4fa5a3a51789c91c449f 2023-02-11 19:55:45,041 INFO [RS:0;jenkins-hbase4:45897-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 0086a9a022be72d7afa868235730b454/family2 of 0086a9a022be72d7afa868235730b454 into a164b364059b4fa5a3a51789c91c449f(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 19:55:45,041 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 0086a9a022be72d7afa868235730b454: 2023-02-11 19:55:45,041 INFO [RS:0;jenkins-hbase4:45897-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454., storeName=0086a9a022be72d7afa868235730b454/family2, priority=12, startTime=1676145343754; duration=1sec 2023-02-11 19:55:45,041 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-11 19:55:45,041 INFO [RS:0;jenkins-hbase4:45897-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 41e9cd5e0c2aceca461c1cf15a182b3c/family1 in testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:45,041 INFO [RS:0;jenkins-hbase4:45897-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-62dedfe0ab4243159cc965af16601edc, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-df7b960c05ae42f895ac9013faf06841, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-ca381d4e2fb14218b51cb252f8c11562, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-817c372a31c64a729c128640168c3f2a, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/a8fcc2d4dff7476e9d7f469776b01285_SeqId_34_] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp, totalSize=28.9 K 2023-02-11 19:55:45,042 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-62dedfe0ab4243159cc965af16601edc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145319466 2023-02-11 19:55:45,042 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-10dfe7d4feb94f329cd6f96056c69c63, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-08d5567e077741848dbd58da76b14e91, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-df4dd57fefc6452a9613eca356e0e6bf, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-f6829a954d6e44609741440a3acfc4a7] to archive 2023-02-11 19:55:45,043 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:45,043 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-df7b960c05ae42f895ac9013faf06841, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145321251 2023-02-11 19:55:45,043 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-ca381d4e2fb14218b51cb252f8c11562, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145323042 2023-02-11 19:55:45,044 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-817c372a31c64a729c128640168c3f2a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145324434 2023-02-11 19:55:45,044 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] compactions.Compactor(207): Compacting a8fcc2d4dff7476e9d7f469776b01285_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1676145319466 2023-02-11 19:55:45,045 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-10dfe7d4feb94f329cd6f96056c69c63 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-10dfe7d4feb94f329cd6f96056c69c63 2023-02-11 19:55:45,046 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-08d5567e077741848dbd58da76b14e91 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-08d5567e077741848dbd58da76b14e91 2023-02-11 19:55:45,047 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-df4dd57fefc6452a9613eca356e0e6bf to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-df4dd57fefc6452a9613eca356e0e6bf 2023-02-11 19:55:45,048 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-f6829a954d6e44609741440a3acfc4a7 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/family2/testCompactionWithHFileLink=0086a9a022be72d7afa868235730b454-f6829a954d6e44609741440a3acfc4a7 2023-02-11 19:55:45,058 INFO [RS:0;jenkins-hbase4:45897-longCompactions-0] throttle.PressureAwareThroughputController(145): 41e9cd5e0c2aceca461c1cf15a182b3c#family1#compaction#117 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-02-11 19:55:45,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-11 19:55:45,122 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-11 19:55:45,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-02-11 19:55:45,124 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:55:45,124 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-02-11 19:55:45,125 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:55:45,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-11 19:55:45,127 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c 2023-02-11 19:55:45,127 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57 2023-02-11 19:55:45,127 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b 2023-02-11 19:55:45,127 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b empty. 2023-02-11 19:55:45,127 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57 empty. 2023-02-11 19:55:45,127 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c empty. 2023-02-11 19:55:45,128 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b 2023-02-11 19:55:45,128 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c 2023-02-11 19:55:45,128 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57 2023-02-11 19:55:45,128 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-02-11 19:55:45,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-11 19:55:45,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-11 19:55:45,534 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-02-11 19:55:45,535 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7671): creating {ENCODED => 6812f076b430f985f8f3eb44f6e4404b, NAME => 'ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp 2023-02-11 19:55:45,536 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7671): creating {ENCODED => 80bcde05173896e6ceb86130796e3c57, NAME => 'ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp 2023-02-11 19:55:45,536 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4d3bfd92285822c834526e098976e53c, NAME => 'ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp 2023-02-11 19:55:45,541 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:55:45,541 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1603): Closing 4d3bfd92285822c834526e098976e53c, disabling compactions & flushes 2023-02-11 19:55:45,541 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:55:45,541 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:55:45,541 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. after waiting 0 ms 2023-02-11 19:55:45,541 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:55:45,541 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:55:45,541 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1557): Region close journal for 4d3bfd92285822c834526e098976e53c: Waiting for close lock at 1676145345541Disabling compacts and flushes for region at 1676145345541Disabling writes for close at 1676145345541Writing region close event to WAL at 1676145345541Closed at 1676145345541 2023-02-11 19:55:45,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-11 19:55:45,873 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family1/a78ec46157c14a1b8fc8bdb49e8e2123 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/a78ec46157c14a1b8fc8bdb49e8e2123 2023-02-11 19:55:45,877 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 42f2c6a1e29ae18303d02e7977b355c5/family1 of 42f2c6a1e29ae18303d02e7977b355c5 into a78ec46157c14a1b8fc8bdb49e8e2123(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 19:55:45,877 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 42f2c6a1e29ae18303d02e7977b355c5: 2023-02-11 19:55:45,877 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1676145344568; duration=1sec 2023-02-11 19:55:45,878 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-11 19:55:45,878 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-11 19:55:45,879 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-11 19:55:45,879 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1912): 41e9cd5e0c2aceca461c1cf15a182b3c/family2 is initiating minor compaction (all files) 2023-02-11 19:55:45,879 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 41e9cd5e0c2aceca461c1cf15a182b3c/family2 in testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:55:45,880 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-97eef38102724ed2b51e73049cb17d47, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-8a5a90da6ec842cb8b44d6b14cf6d9f0, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-5110c81cf90a4b1f9698c8270d2ed018, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-1a8baca107dc4039b450d62d971f2a85] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp, totalSize=20.4 K 2023-02-11 19:55:45,880 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-97eef38102724ed2b51e73049cb17d47, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145319466 2023-02-11 19:55:45,881 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-8a5a90da6ec842cb8b44d6b14cf6d9f0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145321251 2023-02-11 19:55:45,881 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-5110c81cf90a4b1f9698c8270d2ed018, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145323042 2023-02-11 19:55:45,881 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-1a8baca107dc4039b450d62d971f2a85, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145324434 2023-02-11 19:55:45,892 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] throttle.PressureAwareThroughputController(145): 41e9cd5e0c2aceca461c1cf15a182b3c#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-02-11 19:55:45,935 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-79aa122c58d142cdbb2e5673a05d98f5, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-616ddda77da84c3a837506544b7cb109, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-3533a49f68aa47c793072c555eced063, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-9ceb0ccd412f4f0d9ac61b6ad8f07f73, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/d5f090dd176741ef97795b1512a79780_SeqId_34_] to archive 2023-02-11 19:55:45,935 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:45,941 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:55:45,941 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1603): Closing 80bcde05173896e6ceb86130796e3c57, disabling compactions & flushes 2023-02-11 19:55:45,941 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:55:45,941 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:55:45,941 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. after waiting 0 ms 2023-02-11 19:55:45,942 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:55:45,942 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:55:45,942 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1603): Closing 6812f076b430f985f8f3eb44f6e4404b, disabling compactions & flushes 2023-02-11 19:55:45,942 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:55:45,942 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:55:45,942 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1557): Region close journal for 80bcde05173896e6ceb86130796e3c57: Waiting for close lock at 1676145345941Disabling compacts and flushes for region at 1676145345941Disabling writes for close at 1676145345942 (+1 ms)Writing region close event to WAL at 1676145345942Closed at 1676145345942 2023-02-11 19:55:45,942 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:55:45,942 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. after waiting 0 ms 2023-02-11 19:55:45,942 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:55:45,942 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:55:45,942 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1557): Region close journal for 6812f076b430f985f8f3eb44f6e4404b: Waiting for close lock at 1676145345942Disabling compacts and flushes for region at 1676145345942Disabling writes for close at 1676145345942Writing region close event to WAL at 1676145345942Closed at 1676145345942 2023-02-11 19:55:45,943 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-79aa122c58d142cdbb2e5673a05d98f5 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-79aa122c58d142cdbb2e5673a05d98f5 2023-02-11 19:55:45,945 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:55:45,946 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-616ddda77da84c3a837506544b7cb109 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-616ddda77da84c3a837506544b7cb109 2023-02-11 19:55:45,946 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676145345946"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145345946"}]},"ts":"1676145345946"} 2023-02-11 19:55:45,946 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676145345946"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145345946"}]},"ts":"1676145345946"} 2023-02-11 19:55:45,946 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676145345946"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145345946"}]},"ts":"1676145345946"} 2023-02-11 19:55:45,948 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-3533a49f68aa47c793072c555eced063 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-3533a49f68aa47c793072c555eced063 2023-02-11 19:55:45,950 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-11 19:55:45,950 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-9ceb0ccd412f4f0d9ac61b6ad8f07f73 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-9ceb0ccd412f4f0d9ac61b6ad8f07f73 2023-02-11 19:55:45,951 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:55:45,951 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145345951"}]},"ts":"1676145345951"} 2023-02-11 19:55:45,951 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 19:55:45,953 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/d5f090dd176741ef97795b1512a79780_SeqId_34_ to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family1/d5f090dd176741ef97795b1512a79780_SeqId_34_ 2023-02-11 19:55:45,954 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-02-11 19:55:45,958 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4d3bfd92285822c834526e098976e53c, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=80bcde05173896e6ceb86130796e3c57, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=6812f076b430f985f8f3eb44f6e4404b, ASSIGN}] 2023-02-11 19:55:45,960 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=6812f076b430f985f8f3eb44f6e4404b, ASSIGN 2023-02-11 19:55:45,960 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=80bcde05173896e6ceb86130796e3c57, ASSIGN 2023-02-11 19:55:45,960 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4d3bfd92285822c834526e098976e53c, ASSIGN 2023-02-11 19:55:45,964 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=6812f076b430f985f8f3eb44f6e4404b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=false 2023-02-11 19:55:45,964 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4d3bfd92285822c834526e098976e53c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=false 2023-02-11 19:55:45,964 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=80bcde05173896e6ceb86130796e3c57, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=false 2023-02-11 19:55:46,117 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=6812f076b430f985f8f3eb44f6e4404b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:46,117 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4d3bfd92285822c834526e098976e53c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:46,117 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=80bcde05173896e6ceb86130796e3c57, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:46,117 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676145346117"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145346117"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145346117"}]},"ts":"1676145346117"} 2023-02-11 19:55:46,117 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676145346117"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145346117"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145346117"}]},"ts":"1676145346117"} 2023-02-11 19:55:46,117 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676145346117"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145346117"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145346117"}]},"ts":"1676145346117"} 2023-02-11 19:55:46,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=108, state=RUNNABLE; OpenRegionProcedure 6812f076b430f985f8f3eb44f6e4404b, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:55:46,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure 4d3bfd92285822c834526e098976e53c, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:55:46,120 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=107, state=RUNNABLE; OpenRegionProcedure 80bcde05173896e6ceb86130796e3c57, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:55:46,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-11 19:55:46,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:55:46,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 80bcde05173896e6ceb86130796e3c57, NAME => 'ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57.', STARTKEY => '1', ENDKEY => '2'} 2023-02-11 19:55:46,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 80bcde05173896e6ceb86130796e3c57 2023-02-11 19:55:46,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:55:46,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 80bcde05173896e6ceb86130796e3c57 2023-02-11 19:55:46,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 80bcde05173896e6ceb86130796e3c57 2023-02-11 19:55:46,276 INFO [StoreOpener-80bcde05173896e6ceb86130796e3c57-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 80bcde05173896e6ceb86130796e3c57 2023-02-11 19:55:46,277 DEBUG [StoreOpener-80bcde05173896e6ceb86130796e3c57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1 2023-02-11 19:55:46,277 DEBUG [StoreOpener-80bcde05173896e6ceb86130796e3c57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1 2023-02-11 19:55:46,277 INFO [StoreOpener-80bcde05173896e6ceb86130796e3c57-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80bcde05173896e6ceb86130796e3c57 columnFamilyName family1 2023-02-11 19:55:46,278 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family1/a69450b1cfec4d5fa7a7714a5d6d81dc as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/a69450b1cfec4d5fa7a7714a5d6d81dc 2023-02-11 19:55:46,279 INFO [StoreOpener-80bcde05173896e6ceb86130796e3c57-1] regionserver.HStore(310): Store=80bcde05173896e6ceb86130796e3c57/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:55:46,279 INFO [StoreOpener-80bcde05173896e6ceb86130796e3c57-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 80bcde05173896e6ceb86130796e3c57 2023-02-11 19:55:46,280 DEBUG [StoreOpener-80bcde05173896e6ceb86130796e3c57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2 2023-02-11 19:55:46,280 DEBUG [StoreOpener-80bcde05173896e6ceb86130796e3c57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2 2023-02-11 19:55:46,280 INFO [StoreOpener-80bcde05173896e6ceb86130796e3c57-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80bcde05173896e6ceb86130796e3c57 columnFamilyName family2 2023-02-11 19:55:46,281 INFO [StoreOpener-80bcde05173896e6ceb86130796e3c57-1] regionserver.HStore(310): Store=80bcde05173896e6ceb86130796e3c57/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:55:46,282 INFO [RS:0;jenkins-hbase4:45897-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 41e9cd5e0c2aceca461c1cf15a182b3c/family1 of 41e9cd5e0c2aceca461c1cf15a182b3c into a69450b1cfec4d5fa7a7714a5d6d81dc(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 19:55:46,282 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 41e9cd5e0c2aceca461c1cf15a182b3c: 2023-02-11 19:55:46,282 INFO [RS:0;jenkins-hbase4:45897-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1676145344960; duration=1sec 2023-02-11 19:55:46,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57 2023-02-11 19:55:46,282 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-11 19:55:46,282 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-11 19:55:46,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57 2023-02-11 19:55:46,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:55:46,285 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-11 19:55:46,285 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] regionserver.HStore(1912): 42f2c6a1e29ae18303d02e7977b355c5/family2 is initiating minor compaction (all files) 2023-02-11 19:55:46,285 INFO [RS:0;jenkins-hbase4:45897-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 42f2c6a1e29ae18303d02e7977b355c5/family2 in testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:55:46,285 INFO [RS:0;jenkins-hbase4:45897-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-b9364ca0030f4bfe9f7a345dc3efb560, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-c5e29be64d8f4e40b0536b4a879e39a8, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-1545ab26592045bca34bf17dc9efd3d6, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-c274a0499f9c4b50a03fd9f9868b0a5b] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp, totalSize=20.4 K 2023-02-11 19:55:46,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 80bcde05173896e6ceb86130796e3c57 2023-02-11 19:55:46,285 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-b9364ca0030f4bfe9f7a345dc3efb560, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145319467 2023-02-11 19:55:46,286 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-c5e29be64d8f4e40b0536b4a879e39a8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145321251 2023-02-11 19:55:46,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:55:46,287 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-1545ab26592045bca34bf17dc9efd3d6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145323042 2023-02-11 19:55:46,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 80bcde05173896e6ceb86130796e3c57; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71709998, jitterRate=0.06856223940849304}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:55:46,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 80bcde05173896e6ceb86130796e3c57: Running coprocessor pre-open hook at 1676145346275Writing region info on filesystem at 1676145346275Initializing all the Stores at 1676145346275Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145346275Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145346276 (+1 ms)Cleaning up temporary data from old regions at 1676145346283 (+7 ms)Cleaning up detritus from prior splits at 1676145346283Running coprocessor post-open hooks at 1676145346287 (+4 ms)Region opened successfully at 1676145346287 2023-02-11 19:55:46,287 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-c274a0499f9c4b50a03fd9f9868b0a5b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145324434 2023-02-11 19:55:46,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57., pid=111, masterSystemTime=1676145346271 2023-02-11 19:55:46,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:55:46,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:55:46,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:55:46,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4d3bfd92285822c834526e098976e53c, NAME => 'ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c.', STARTKEY => '', ENDKEY => '1'} 2023-02-11 19:55:46,289 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=80bcde05173896e6ceb86130796e3c57, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:46,289 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676145346289"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145346289"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145346289"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145346289"}]},"ts":"1676145346289"} 2023-02-11 19:55:46,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 4d3bfd92285822c834526e098976e53c 2023-02-11 19:55:46,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:55:46,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4d3bfd92285822c834526e098976e53c 2023-02-11 19:55:46,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4d3bfd92285822c834526e098976e53c 2023-02-11 19:55:46,291 INFO [StoreOpener-4d3bfd92285822c834526e098976e53c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4d3bfd92285822c834526e098976e53c 2023-02-11 19:55:46,292 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=107 2023-02-11 19:55:46,292 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=107, state=SUCCESS; OpenRegionProcedure 80bcde05173896e6ceb86130796e3c57, server=jenkins-hbase4.apache.org,45897,1676145215747 in 170 msec 2023-02-11 19:55:46,292 DEBUG [StoreOpener-4d3bfd92285822c834526e098976e53c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1 2023-02-11 19:55:46,293 DEBUG [StoreOpener-4d3bfd92285822c834526e098976e53c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1 2023-02-11 19:55:46,293 INFO [StoreOpener-4d3bfd92285822c834526e098976e53c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d3bfd92285822c834526e098976e53c columnFamilyName family1 2023-02-11 19:55:46,293 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=80bcde05173896e6ceb86130796e3c57, ASSIGN in 334 msec 2023-02-11 19:55:46,293 INFO [StoreOpener-4d3bfd92285822c834526e098976e53c-1] regionserver.HStore(310): Store=4d3bfd92285822c834526e098976e53c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:55:46,294 INFO [StoreOpener-4d3bfd92285822c834526e098976e53c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4d3bfd92285822c834526e098976e53c 2023-02-11 19:55:46,295 DEBUG [StoreOpener-4d3bfd92285822c834526e098976e53c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2 2023-02-11 19:55:46,295 DEBUG [StoreOpener-4d3bfd92285822c834526e098976e53c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2 2023-02-11 19:55:46,295 INFO [StoreOpener-4d3bfd92285822c834526e098976e53c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d3bfd92285822c834526e098976e53c columnFamilyName family2 2023-02-11 19:55:46,296 INFO [StoreOpener-4d3bfd92285822c834526e098976e53c-1] regionserver.HStore(310): Store=4d3bfd92285822c834526e098976e53c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:55:46,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c 2023-02-11 19:55:46,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c 2023-02-11 19:55:46,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:55:46,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4d3bfd92285822c834526e098976e53c 2023-02-11 19:55:46,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:55:46,303 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4d3bfd92285822c834526e098976e53c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63309659, jitterRate=-0.056612566113471985}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:55:46,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4d3bfd92285822c834526e098976e53c: Running coprocessor pre-open hook at 1676145346290Writing region info on filesystem at 1676145346290Initializing all the Stores at 1676145346291 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145346291Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145346291Cleaning up temporary data from old regions at 1676145346299 (+8 ms)Cleaning up detritus from prior splits at 1676145346300 (+1 ms)Running coprocessor post-open hooks at 1676145346303 (+3 ms)Region opened successfully at 1676145346303 2023-02-11 19:55:46,304 INFO [RS:0;jenkins-hbase4:45897-longCompactions-0] throttle.PressureAwareThroughputController(145): 42f2c6a1e29ae18303d02e7977b355c5#family2#compaction#119 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-02-11 19:55:46,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c., pid=110, masterSystemTime=1676145346271 2023-02-11 19:55:46,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:55:46,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:55:46,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:55:46,306 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4d3bfd92285822c834526e098976e53c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:46,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6812f076b430f985f8f3eb44f6e4404b, NAME => 'ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b.', STARTKEY => '2', ENDKEY => ''} 2023-02-11 19:55:46,306 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676145346306"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145346306"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145346306"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145346306"}]},"ts":"1676145346306"} 2023-02-11 19:55:46,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 6812f076b430f985f8f3eb44f6e4404b 2023-02-11 19:55:46,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:55:46,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6812f076b430f985f8f3eb44f6e4404b 2023-02-11 19:55:46,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6812f076b430f985f8f3eb44f6e4404b 2023-02-11 19:55:46,307 INFO [StoreOpener-6812f076b430f985f8f3eb44f6e4404b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6812f076b430f985f8f3eb44f6e4404b 2023-02-11 19:55:46,308 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=106 2023-02-11 19:55:46,308 DEBUG [StoreOpener-6812f076b430f985f8f3eb44f6e4404b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1 2023-02-11 19:55:46,308 DEBUG [StoreOpener-6812f076b430f985f8f3eb44f6e4404b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1 2023-02-11 19:55:46,308 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure 4d3bfd92285822c834526e098976e53c, server=jenkins-hbase4.apache.org,45897,1676145215747 in 187 msec 2023-02-11 19:55:46,309 INFO [StoreOpener-6812f076b430f985f8f3eb44f6e4404b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6812f076b430f985f8f3eb44f6e4404b columnFamilyName family1 2023-02-11 19:55:46,309 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4d3bfd92285822c834526e098976e53c, ASSIGN in 350 msec 2023-02-11 19:55:46,309 INFO [StoreOpener-6812f076b430f985f8f3eb44f6e4404b-1] regionserver.HStore(310): Store=6812f076b430f985f8f3eb44f6e4404b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:55:46,310 INFO [StoreOpener-6812f076b430f985f8f3eb44f6e4404b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6812f076b430f985f8f3eb44f6e4404b 2023-02-11 19:55:46,311 DEBUG [StoreOpener-6812f076b430f985f8f3eb44f6e4404b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2 2023-02-11 19:55:46,311 DEBUG [StoreOpener-6812f076b430f985f8f3eb44f6e4404b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2 2023-02-11 19:55:46,311 INFO [StoreOpener-6812f076b430f985f8f3eb44f6e4404b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6812f076b430f985f8f3eb44f6e4404b columnFamilyName family2 2023-02-11 19:55:46,311 INFO [StoreOpener-6812f076b430f985f8f3eb44f6e4404b-1] regionserver.HStore(310): Store=6812f076b430f985f8f3eb44f6e4404b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:55:46,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b 2023-02-11 19:55:46,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b 2023-02-11 19:55:46,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:55:46,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6812f076b430f985f8f3eb44f6e4404b 2023-02-11 19:55:46,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:55:46,316 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6812f076b430f985f8f3eb44f6e4404b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67504216, jitterRate=0.005891203880310059}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:55:46,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6812f076b430f985f8f3eb44f6e4404b: Running coprocessor pre-open hook at 1676145346306Writing region info on filesystem at 1676145346306Initializing all the Stores at 1676145346307 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145346307Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145346307Cleaning up temporary data from old regions at 1676145346313 (+6 ms)Cleaning up detritus from prior splits at 1676145346313Running coprocessor post-open hooks at 1676145346316 (+3 ms)Region opened successfully at 1676145346316 2023-02-11 19:55:46,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b., pid=109, masterSystemTime=1676145346271 2023-02-11 19:55:46,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:55:46,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:55:46,318 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=6812f076b430f985f8f3eb44f6e4404b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:46,318 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676145346318"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145346318"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145346318"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145346318"}]},"ts":"1676145346318"} 2023-02-11 19:55:46,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=108 2023-02-11 19:55:46,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=108, state=SUCCESS; OpenRegionProcedure 6812f076b430f985f8f3eb44f6e4404b, server=jenkins-hbase4.apache.org,45897,1676145215747 in 200 msec 2023-02-11 19:55:46,322 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=105 2023-02-11 19:55:46,322 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=6812f076b430f985f8f3eb44f6e4404b, ASSIGN in 362 msec 2023-02-11 19:55:46,322 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:55:46,322 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145346322"}]},"ts":"1676145346322"} 2023-02-11 19:55:46,323 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-02-11 19:55:46,325 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:55:46,326 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2030 sec 2023-02-11 19:55:46,334 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-62dedfe0ab4243159cc965af16601edc, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-df7b960c05ae42f895ac9013faf06841, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-ca381d4e2fb14218b51cb252f8c11562, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-817c372a31c64a729c128640168c3f2a, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/a8fcc2d4dff7476e9d7f469776b01285_SeqId_34_] to archive 2023-02-11 19:55:46,335 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:46,336 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-62dedfe0ab4243159cc965af16601edc to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-62dedfe0ab4243159cc965af16601edc 2023-02-11 19:55:46,337 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-df7b960c05ae42f895ac9013faf06841 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-df7b960c05ae42f895ac9013faf06841 2023-02-11 19:55:46,338 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-ca381d4e2fb14218b51cb252f8c11562 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-ca381d4e2fb14218b51cb252f8c11562 2023-02-11 19:55:46,339 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-817c372a31c64a729c128640168c3f2a to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-817c372a31c64a729c128640168c3f2a 2023-02-11 19:55:46,339 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/a8fcc2d4dff7476e9d7f469776b01285_SeqId_34_ to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family1/a8fcc2d4dff7476e9d7f469776b01285_SeqId_34_ 2023-02-11 19:55:47,110 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/.tmp/family2/5186e28d4b084dde8d8720f3b58497ea as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/5186e28d4b084dde8d8720f3b58497ea 2023-02-11 19:55:47,115 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 41e9cd5e0c2aceca461c1cf15a182b3c/family2 of 41e9cd5e0c2aceca461c1cf15a182b3c into 5186e28d4b084dde8d8720f3b58497ea(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 19:55:47,115 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 41e9cd5e0c2aceca461c1cf15a182b3c: 2023-02-11 19:55:47,115 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c., storeName=41e9cd5e0c2aceca461c1cf15a182b3c/family2, priority=12, startTime=1676145343914; duration=1sec 2023-02-11 19:55:47,115 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-11 19:55:47,115 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-02-11 19:55:47,115 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-11 19:55:47,115 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-11 19:55:47,115 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. because compaction request was cancelled 2023-02-11 19:55:47,115 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-02-11 19:55:47,116 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-11 19:55:47,116 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-11 19:55:47,116 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. because compaction request was cancelled 2023-02-11 19:55:47,134 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-97eef38102724ed2b51e73049cb17d47, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-8a5a90da6ec842cb8b44d6b14cf6d9f0, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-5110c81cf90a4b1f9698c8270d2ed018, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-1a8baca107dc4039b450d62d971f2a85] to archive 2023-02-11 19:55:47,135 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:47,136 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-97eef38102724ed2b51e73049cb17d47 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-97eef38102724ed2b51e73049cb17d47 2023-02-11 19:55:47,138 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-8a5a90da6ec842cb8b44d6b14cf6d9f0 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-8a5a90da6ec842cb8b44d6b14cf6d9f0 2023-02-11 19:55:47,139 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-5110c81cf90a4b1f9698c8270d2ed018 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-5110c81cf90a4b1f9698c8270d2ed018 2023-02-11 19:55:47,140 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-1a8baca107dc4039b450d62d971f2a85 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/family2/testCompactionWithHFileLink=41e9cd5e0c2aceca461c1cf15a182b3c-1a8baca107dc4039b450d62d971f2a85 2023-02-11 19:55:47,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-11 19:55:47,230 INFO [Listener at localhost/32929] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-02-11 19:55:47,235 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:47,236 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:47,236 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:47,238 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:55:47,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-11 19:55:47,239 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-11 19:55:47,239 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:47,239 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-11 19:55:47,239 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-11 19:55:47,240 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:47,240 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:47,243 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:47,243 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:47,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:47,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:47,243 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:47,243 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:55:47,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:47,244 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:47,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:55:47,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:47,244 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-11 19:55:47,244 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-11 19:55:47,244 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-11 19:55:47,244 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:47,244 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-11 19:55:47,244 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:55:47,244 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. started... 2023-02-11 19:55:47,245 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:55:47,245 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 19:55:47,246 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:55:47,246 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. started... 2023-02-11 19:55:47,245 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. started... 2023-02-11 19:55:47,246 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6812f076b430f985f8f3eb44f6e4404b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 19:55:47,246 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:55:47,246 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 4d3bfd92285822c834526e098976e53c 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 19:55:47,246 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 80bcde05173896e6ceb86130796e3c57 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 19:55:47,524 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/.tmp/family2/7c8a3ec4ef05499d9b5546c97e001212 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/7c8a3ec4ef05499d9b5546c97e001212 2023-02-11 19:55:47,528 INFO [RS:0;jenkins-hbase4:45897-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 42f2c6a1e29ae18303d02e7977b355c5/family2 of 42f2c6a1e29ae18303d02e7977b355c5 into 7c8a3ec4ef05499d9b5546c97e001212(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 19:55:47,528 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 42f2c6a1e29ae18303d02e7977b355c5: 2023-02-11 19:55:47,528 INFO [RS:0;jenkins-hbase4:45897-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5., storeName=42f2c6a1e29ae18303d02e7977b355c5/family2, priority=12, startTime=1676145343850; duration=1sec 2023-02-11 19:55:47,528 DEBUG [RS:0;jenkins-hbase4:45897-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:55:47,534 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-b9364ca0030f4bfe9f7a345dc3efb560, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-c5e29be64d8f4e40b0536b4a879e39a8, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-1545ab26592045bca34bf17dc9efd3d6, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-c274a0499f9c4b50a03fd9f9868b0a5b] to archive 2023-02-11 19:55:47,535 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:47,536 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-b9364ca0030f4bfe9f7a345dc3efb560 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-b9364ca0030f4bfe9f7a345dc3efb560 2023-02-11 19:55:47,537 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-c5e29be64d8f4e40b0536b4a879e39a8 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-c5e29be64d8f4e40b0536b4a879e39a8 2023-02-11 19:55:47,538 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-1545ab26592045bca34bf17dc9efd3d6 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-1545ab26592045bca34bf17dc9efd3d6 2023-02-11 19:55:47,539 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-c274a0499f9c4b50a03fd9f9868b0a5b to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/family2/testCompactionWithHFileLink=42f2c6a1e29ae18303d02e7977b355c5-c274a0499f9c4b50a03fd9f9868b0a5b 2023-02-11 19:55:47,658 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302110a95e907e6f6462baea59d4305d06917 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302110a95e907e6f6462baea59d4305d06917 2023-02-11 19:55:47,658 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021161a1f6bca37f4ea787980e446acec32a to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023021161a1f6bca37f4ea787980e446acec32a 2023-02-11 19:55:47,658 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211f46e7fa1c4a542f29db722d1c8662e41 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230211f46e7fa1c4a542f29db722d1c8662e41 2023-02-11 19:55:48,063 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp/family1/37866ca18dc549b6922032b10d6a90bf 2023-02-11 19:55:48,064 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp/family1/0598d061961440ab9f309c856ecad3fc 2023-02-11 19:55:48,064 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp/family1/9f56eb5abca74f58842bf4fc1ab4f71d 2023-02-11 19:55:48,489 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302110ab3c7d1d8fd4fbaa9d8769821e24c98 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302110ab3c7d1d8fd4fbaa9d8769821e24c98 2023-02-11 19:55:48,489 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302111dfbbc277fb942a6aa58c3b4d8e05095 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302111dfbbc277fb942a6aa58c3b4d8e05095 2023-02-11 19:55:48,493 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211840b7db629aa414b84ea2dec4e3cd39c to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230211840b7db629aa414b84ea2dec4e3cd39c 2023-02-11 19:55:48,503 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp/family2/2848c32c25154896b539666148ab49c3 2023-02-11 19:55:48,507 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp/family1/0598d061961440ab9f309c856ecad3fc as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/0598d061961440ab9f309c856ecad3fc 2023-02-11 19:55:48,510 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/0598d061961440ab9f309c856ecad3fc, entries=4, sequenceid=5, filesize=5.4 K 2023-02-11 19:55:48,511 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp/family2/2848c32c25154896b539666148ab49c3 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/2848c32c25154896b539666148ab49c3 2023-02-11 19:55:48,514 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/2848c32c25154896b539666148ab49c3, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 19:55:48,514 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 80bcde05173896e6ceb86130796e3c57 in 1268ms, sequenceid=5, compaction requested=false 2023-02-11 19:55:48,515 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-02-11 19:55:48,515 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 80bcde05173896e6ceb86130796e3c57: 2023-02-11 19:55:48,515 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:55:48,515 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 19:55:48,899 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp/family2/a4466a48a3664e8a8bccb2913c8340a2 2023-02-11 19:55:48,903 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp/family1/9f56eb5abca74f58842bf4fc1ab4f71d as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/9f56eb5abca74f58842bf4fc1ab4f71d 2023-02-11 19:55:48,905 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp/family2/dc1a90e525eb46d585cbaaf3a1655c84 2023-02-11 19:55:48,906 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/9f56eb5abca74f58842bf4fc1ab4f71d, entries=4, sequenceid=5, filesize=5.4 K 2023-02-11 19:55:48,906 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp/family2/a4466a48a3664e8a8bccb2913c8340a2 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/a4466a48a3664e8a8bccb2913c8340a2 2023-02-11 19:55:48,908 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp/family1/37866ca18dc549b6922032b10d6a90bf as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/37866ca18dc549b6922032b10d6a90bf 2023-02-11 19:55:48,910 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/a4466a48a3664e8a8bccb2913c8340a2, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 19:55:48,910 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 6812f076b430f985f8f3eb44f6e4404b in 1664ms, sequenceid=5, compaction requested=false 2023-02-11 19:55:48,911 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6812f076b430f985f8f3eb44f6e4404b: 2023-02-11 19:55:48,911 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:55:48,911 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 19:55:48,912 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/37866ca18dc549b6922032b10d6a90bf, entries=4, sequenceid=5, filesize=5.4 K 2023-02-11 19:55:48,913 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp/family2/dc1a90e525eb46d585cbaaf3a1655c84 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/dc1a90e525eb46d585cbaaf3a1655c84 2023-02-11 19:55:48,916 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/dc1a90e525eb46d585cbaaf3a1655c84, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 19:55:48,916 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 4d3bfd92285822c834526e098976e53c in 1670ms, sequenceid=5, compaction requested=false 2023-02-11 19:55:48,916 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4d3bfd92285822c834526e098976e53c: 2023-02-11 19:55:48,916 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:55:48,916 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 19:55:48,916 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 19:55:48,916 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:48,916 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-11 19:55:48,916 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-11 19:55:48,918 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:48,918 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:48,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:48,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:48,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:48,918 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:48,918 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:55:48,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:48,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:48,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:48,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:48,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:48,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-11 19:55:48,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20dfdf97[Count = 0] remaining members to acquire global barrier 2023-02-11 19:55:48,919 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-11 19:55:48,919 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:48,920 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:48,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:48,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:48,920 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-11 19:55:48,921 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-11 19:55:48,921 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:55:48,921 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:48,921 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:55:48,922 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-11 19:55:48,922 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:48,922 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-11 19:55:48,922 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:48,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:48,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:48,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:48,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:48,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:48,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:55:48,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-11 19:55:48,924 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-11 19:55:48,924 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:55:48,924 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:55:48,924 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-11 19:55:48,924 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:55:48,926 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:48,926 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:48,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:48,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:48,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:48,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:48,927 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:48,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:48,927 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:48,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:48,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:48,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:48,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:48,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:48,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:48,928 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:48,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:48,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:48,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:48,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:48,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:48,930 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:48,930 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:48,930 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:48,930 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:48,930 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:48,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:48,930 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-11 19:55:48,930 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:55:48,930 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:48,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:48,930 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:48,930 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-11 19:55:48,930 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:48,931 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-11 19:55:48,931 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:55:48,931 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:48,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:48,931 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:49,031 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:55:49,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:55:49,033 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:49,034 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:49,034 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:49,036 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:55:49,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-11 19:55:49,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-11 19:55:49,037 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-11 19:55:49,037 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:49,037 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-11 19:55:49,037 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-11 19:55:49,038 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:49,038 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:49,039 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:49,039 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:49,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:49,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:49,039 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:49,039 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:55:49,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:49,040 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:49,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:55:49,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:49,040 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-11 19:55:49,040 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-11 19:55:49,040 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-11 19:55:49,040 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-11 19:55:49,040 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:49,040 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-11 19:55:49,040 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:55:49,041 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. started... 2023-02-11 19:55:49,041 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 19:55:49,041 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:55:49,041 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:55:49,041 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6812f076b430f985f8f3eb44f6e4404b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 19:55:49,041 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:55:49,041 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. started... 2023-02-11 19:55:49,041 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. started... 2023-02-11 19:55:49,041 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 80bcde05173896e6ceb86130796e3c57 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 19:55:49,041 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 4d3bfd92285822c834526e098976e53c 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 19:55:49,453 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211b08195820527469597dba3bf33a27e37 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230211b08195820527469597dba3bf33a27e37 2023-02-11 19:55:49,457 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302116ac3a30562494724a86e0a0b1831c4bf to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302116ac3a30562494724a86e0a0b1831c4bf 2023-02-11 19:55:49,460 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211c726764ff7d3450c806f591097c956cf to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230211c726764ff7d3450c806f591097c956cf 2023-02-11 19:55:49,859 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp/family1/356686d997ba48a1ae541c67162d6e3c 2023-02-11 19:55:49,862 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp/family1/d398edb8432b44c6b625b2996f3d5eb5 2023-02-11 19:55:49,864 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp/family1/811fa1e213144bae8a8d2f6c894d6479 2023-02-11 19:55:50,273 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021110e28652825247e997677ad6565296f5 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023021110e28652825247e997677ad6565296f5 2023-02-11 19:55:50,276 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021121771b648c9d4210a264cec00f3458e5 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023021121771b648c9d4210a264cec00f3458e5 2023-02-11 19:55:50,277 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302110a51f0a8f96a4dbaa9cfdb5535b8db2a to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302110a51f0a8f96a4dbaa9cfdb5535b8db2a 2023-02-11 19:55:50,281 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp/family2/1690561216594909b698a8c10addbaae 2023-02-11 19:55:50,286 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp/family1/356686d997ba48a1ae541c67162d6e3c as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/356686d997ba48a1ae541c67162d6e3c 2023-02-11 19:55:50,289 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/356686d997ba48a1ae541c67162d6e3c, entries=4, sequenceid=9, filesize=5.4 K 2023-02-11 19:55:50,290 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp/family2/1690561216594909b698a8c10addbaae as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/1690561216594909b698a8c10addbaae 2023-02-11 19:55:50,293 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/1690561216594909b698a8c10addbaae, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 19:55:50,294 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 4d3bfd92285822c834526e098976e53c in 1253ms, sequenceid=9, compaction requested=false 2023-02-11 19:55:50,294 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4d3bfd92285822c834526e098976e53c: 2023-02-11 19:55:50,294 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:55:50,294 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 19:55:50,684 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp/family2/5a9f748b4d34487d98271f0cbe0946e0 2023-02-11 19:55:50,687 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp/family1/d398edb8432b44c6b625b2996f3d5eb5 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/d398edb8432b44c6b625b2996f3d5eb5 2023-02-11 19:55:50,690 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/d398edb8432b44c6b625b2996f3d5eb5, entries=4, sequenceid=9, filesize=5.4 K 2023-02-11 19:55:50,691 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp/family2/5a9f748b4d34487d98271f0cbe0946e0 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/5a9f748b4d34487d98271f0cbe0946e0 2023-02-11 19:55:50,694 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/5a9f748b4d34487d98271f0cbe0946e0, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 19:55:50,694 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 6812f076b430f985f8f3eb44f6e4404b in 1653ms, sequenceid=9, compaction requested=false 2023-02-11 19:55:50,695 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6812f076b430f985f8f3eb44f6e4404b: 2023-02-11 19:55:50,695 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:55:50,695 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 19:55:50,696 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp/family2/2807f3d9451446db9a4c14d9a30d915a 2023-02-11 19:55:50,699 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp/family1/811fa1e213144bae8a8d2f6c894d6479 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/811fa1e213144bae8a8d2f6c894d6479 2023-02-11 19:55:50,702 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/811fa1e213144bae8a8d2f6c894d6479, entries=4, sequenceid=9, filesize=5.4 K 2023-02-11 19:55:50,703 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp/family2/2807f3d9451446db9a4c14d9a30d915a as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/2807f3d9451446db9a4c14d9a30d915a 2023-02-11 19:55:50,706 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/2807f3d9451446db9a4c14d9a30d915a, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 19:55:50,707 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 80bcde05173896e6ceb86130796e3c57 in 1666ms, sequenceid=9, compaction requested=false 2023-02-11 19:55:50,707 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 80bcde05173896e6ceb86130796e3c57: 2023-02-11 19:55:50,707 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:55:50,707 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 19:55:50,707 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 19:55:50,707 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:50,707 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-11 19:55:50,707 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-11 19:55:50,709 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:50,709 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:50,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:50,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:50,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:50,709 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:50,709 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:55:50,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:50,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:50,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:50,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:50,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:50,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-11 19:55:50,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38c9dac3[Count = 0] remaining members to acquire global barrier 2023-02-11 19:55:50,710 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-11 19:55:50,710 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:50,712 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:50,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:50,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:50,713 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-11 19:55:50,713 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-11 19:55:50,713 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:55:50,713 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:50,713 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:55:50,721 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-11 19:55:50,721 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:50,721 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:50,721 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-11 19:55:50,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:50,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:50,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:50,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:50,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:50,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:50,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:50,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:50,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:50,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:50,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:55:50,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-11 19:55:50,723 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-11 19:55:50,723 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:55:50,723 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:55:50,723 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-11 19:55:50,723 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:55:50,725 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:50,725 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:50,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:50,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:50,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:50,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:50,725 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:50,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:50,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:50,725 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:50,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:50,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:50,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:50,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:50,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:50,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:50,726 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:50,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:50,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:50,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:50,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:50,729 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:50,729 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:50,729 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:50,729 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:50,729 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:50,729 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-11 19:55:50,729 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:55:50,729 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:50,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:50,729 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:50,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:50,729 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:50,729 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:50,729 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:50,729 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-11 19:55:50,729 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:55:50,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:50,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:50,830 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:55:50,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:55:50,831 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:50,832 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:50,832 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:50,834 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:55:50,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-11 19:55:50,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-11 19:55:50,836 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-11 19:55:50,836 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:50,836 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-11 19:55:50,836 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-11 19:55:50,836 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:50,836 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:50,837 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:50,837 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:50,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:50,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:50,837 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:50,837 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:55:50,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:50,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:50,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:55:50,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:50,838 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-11 19:55:50,838 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-11 19:55:50,838 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-11 19:55:50,838 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-11 19:55:50,838 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:50,838 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-11 19:55:50,839 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:55:50,839 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:55:50,839 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. started... 2023-02-11 19:55:50,839 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. started... 2023-02-11 19:55:50,839 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 19:55:50,839 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:55:50,839 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:55:50,839 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6812f076b430f985f8f3eb44f6e4404b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 19:55:50,839 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 4d3bfd92285822c834526e098976e53c 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 19:55:50,839 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. started... 2023-02-11 19:55:50,839 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 80bcde05173896e6ceb86130796e3c57 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 19:55:50,861 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021169bc2f6bc49a476d9765da3024821a79 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023021169bc2f6bc49a476d9765da3024821a79 2023-02-11 19:55:51,258 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211f08c2e3d72eb42acb263bd667f6f343b to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230211f08c2e3d72eb42acb263bd667f6f343b 2023-02-11 19:55:51,260 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021172a04d30d48e4cbe971079bd7e5b69a8 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023021172a04d30d48e4cbe971079bd7e5b69a8 2023-02-11 19:55:51,265 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp/family1/0c8faec5126943c88cb793e35be67438 2023-02-11 19:55:51,663 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp/family1/6df166328d6e4d47a239d3ddeb137efb 2023-02-11 19:55:51,665 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp/family1/4471d377ed06433d89ae86e1175ddef9 2023-02-11 19:55:51,677 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211e2c705f47a43474093ab476fe4121f11 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230211e2c705f47a43474093ab476fe4121f11 2023-02-11 19:55:51,678 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021140dc08aa293445eb8973c4722acebbe3 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023021140dc08aa293445eb8973c4722acebbe3 2023-02-11 19:55:51,776 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 19:55:52,079 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302118db4399a57b64cadb867c10c645df793 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302118db4399a57b64cadb867c10c645df793 2023-02-11 19:55:52,081 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp/family2/eab1cdce697147159b14e872d31603f3 2023-02-11 19:55:52,082 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp/family2/07add2497f2f4c478f2df85cf4957c45 2023-02-11 19:55:52,084 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp/family2/bbc0cbdc5fb54bc19563381217d5a4ed 2023-02-11 19:55:52,085 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp/family1/0c8faec5126943c88cb793e35be67438 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/0c8faec5126943c88cb793e35be67438 2023-02-11 19:55:52,087 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp/family1/4471d377ed06433d89ae86e1175ddef9 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/4471d377ed06433d89ae86e1175ddef9 2023-02-11 19:55:52,088 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp/family1/6df166328d6e4d47a239d3ddeb137efb as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/6df166328d6e4d47a239d3ddeb137efb 2023-02-11 19:55:52,107 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:55:52,107 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18639285 to 127.0.0.1:64025 2023-02-11 19:55:52,107 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:55:52,107 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:55:52,107 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32f4cb3b to 127.0.0.1:64025 2023-02-11 19:55:52,107 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:55:52,110 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/0c8faec5126943c88cb793e35be67438, entries=4, sequenceid=13, filesize=5.4 K 2023-02-11 19:55:52,111 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp/family2/eab1cdce697147159b14e872d31603f3 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/eab1cdce697147159b14e872d31603f3 2023-02-11 19:55:52,113 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/4471d377ed06433d89ae86e1175ddef9, entries=4, sequenceid=13, filesize=5.4 K 2023-02-11 19:55:52,113 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/6df166328d6e4d47a239d3ddeb137efb, entries=4, sequenceid=13, filesize=5.4 K 2023-02-11 19:55:52,114 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp/family2/07add2497f2f4c478f2df85cf4957c45 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/07add2497f2f4c478f2df85cf4957c45 2023-02-11 19:55:52,114 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp/family2/bbc0cbdc5fb54bc19563381217d5a4ed as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/bbc0cbdc5fb54bc19563381217d5a4ed 2023-02-11 19:55:52,121 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/eab1cdce697147159b14e872d31603f3, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 19:55:52,121 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/07add2497f2f4c478f2df85cf4957c45, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 19:55:52,122 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/bbc0cbdc5fb54bc19563381217d5a4ed, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 19:55:52,122 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 6812f076b430f985f8f3eb44f6e4404b in 1283ms, sequenceid=13, compaction requested=true 2023-02-11 19:55:52,122 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 4d3bfd92285822c834526e098976e53c in 1283ms, sequenceid=13, compaction requested=true 2023-02-11 19:55:52,122 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6812f076b430f985f8f3eb44f6e4404b: 2023-02-11 19:55:52,122 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 80bcde05173896e6ceb86130796e3c57 in 1283ms, sequenceid=13, compaction requested=true 2023-02-11 19:55:52,122 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4d3bfd92285822c834526e098976e53c: 2023-02-11 19:55:52,122 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:55:52,122 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:55:52,122 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 19:55:52,122 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 80bcde05173896e6ceb86130796e3c57: 2023-02-11 19:55:52,122 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:55:52,122 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 19:55:52,123 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 19:55:52,123 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 19:55:52,123 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:52,123 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-11 19:55:52,123 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-11 19:55:52,125 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:52,125 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:52,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:52,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:52,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:52,126 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:52,126 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:55:52,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:52,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:52,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:52,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:52,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:52,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-11 19:55:52,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@401d504[Count = 0] remaining members to acquire global barrier 2023-02-11 19:55:52,127 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-11 19:55:52,127 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:52,128 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:52,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:52,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:52,128 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-11 19:55:52,128 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-11 19:55:52,128 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:55:52,128 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:52,128 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:55:52,130 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-11 19:55:52,130 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:52,130 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:52,130 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-11 19:55:52,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:52,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:52,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:52,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:52,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:52,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:52,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:52,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:52,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:52,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:52,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:55:52,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-11 19:55:52,132 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-11 19:55:52,132 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:55:52,132 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:55:52,132 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-11 19:55:52,132 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:55:52,133 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:52,133 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:52,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:52,133 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:52,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:52,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:52,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:52,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:52,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:52,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:52,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:52,134 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:52,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:52,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:52,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:52,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:52,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:52,135 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:52,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:52,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:52,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:52,138 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:52,138 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:52,138 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:52,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:52,138 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:52,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:52,138 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-11 19:55:52,138 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:55:52,138 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:52,138 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:52,138 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:52,138 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:52,138 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:52,138 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:52,138 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-11 19:55:52,138 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:55:52,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:52,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:52,238 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:55:52,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:55:52,240 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:52,241 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:52,241 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:55:52,243 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:55:52,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-11 19:55:52,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-11 19:55:52,245 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-11 19:55:52,245 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:52,245 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-11 19:55:52,245 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-11 19:55:52,245 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:52,245 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:52,247 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:52,247 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:52,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:52,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:52,247 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:52,247 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:55:52,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:52,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:52,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:55:52,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:52,248 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-11 19:55:52,252 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-11 19:55:52,252 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-11 19:55:52,252 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-11 19:55:52,252 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:52,252 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-11 19:55:52,252 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:55:52,252 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. started... 2023-02-11 19:55:52,253 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:55:52,253 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6812f076b430f985f8f3eb44f6e4404b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 19:55:52,253 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. started... 2023-02-11 19:55:52,253 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 4d3bfd92285822c834526e098976e53c 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 19:55:52,255 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 19:55:52,255 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:55:52,256 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:55:52,256 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. started... 2023-02-11 19:55:52,256 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 80bcde05173896e6ceb86130796e3c57 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 19:55:52,266 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302113008e422a2ea4c4cb4cf6754ec54c084 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302113008e422a2ea4c4cb4cf6754ec54c084 2023-02-11 19:55:52,267 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211132afdad887940bfa8f62eb9d9eda856 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230211132afdad887940bfa8f62eb9d9eda856 2023-02-11 19:55:52,271 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp/family1/0c4eb23c08954d149dd1b10c774b3e7f 2023-02-11 19:55:52,271 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp/family1/090ff36cf97e41d7bc3b98ad7c695a0c 2023-02-11 19:55:52,285 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211441d4cb5616f43f4a21f41d84fb45e77 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230211441d4cb5616f43f4a21f41d84fb45e77 2023-02-11 19:55:52,289 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp/family2/89242340d8bc4ef7a33be022d25c1391 2023-02-11 19:55:52,292 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp/family1/090ff36cf97e41d7bc3b98ad7c695a0c as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/090ff36cf97e41d7bc3b98ad7c695a0c 2023-02-11 19:55:52,295 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/090ff36cf97e41d7bc3b98ad7c695a0c, entries=4, sequenceid=17, filesize=5.4 K 2023-02-11 19:55:52,296 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp/family2/89242340d8bc4ef7a33be022d25c1391 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/89242340d8bc4ef7a33be022d25c1391 2023-02-11 19:55:52,299 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/89242340d8bc4ef7a33be022d25c1391, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 19:55:52,299 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 80bcde05173896e6ceb86130796e3c57 in 43ms, sequenceid=17, compaction requested=true 2023-02-11 19:55:52,300 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 80bcde05173896e6ceb86130796e3c57: 2023-02-11 19:55:52,300 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:55:52,300 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 19:55:52,667 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302119bcb278ab9bb4a17ad5f1edbb9416f75 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302119bcb278ab9bb4a17ad5f1edbb9416f75 2023-02-11 19:55:52,684 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211d2ed97267d474935bd2fe9c2aa68a461 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230211d2ed97267d474935bd2fe9c2aa68a461 2023-02-11 19:55:53,072 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp/family1/0bbd3bb6f58b4918b2375b75012c527f 2023-02-11 19:55:53,089 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp/family2/cd0b66aab8e14ad3a7b9674c6477987f 2023-02-11 19:55:53,094 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp/family1/0c4eb23c08954d149dd1b10c774b3e7f as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/0c4eb23c08954d149dd1b10c774b3e7f 2023-02-11 19:55:53,098 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/0c4eb23c08954d149dd1b10c774b3e7f, entries=4, sequenceid=17, filesize=5.4 K 2023-02-11 19:55:53,099 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp/family2/cd0b66aab8e14ad3a7b9674c6477987f as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/cd0b66aab8e14ad3a7b9674c6477987f 2023-02-11 19:55:53,102 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/cd0b66aab8e14ad3a7b9674c6477987f, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 19:55:53,103 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 4d3bfd92285822c834526e098976e53c in 850ms, sequenceid=17, compaction requested=true 2023-02-11 19:55:53,103 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4d3bfd92285822c834526e098976e53c: 2023-02-11 19:55:53,103 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:55:53,103 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 19:55:53,488 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211fe74d368a82c4d55a7ad6b69136e2bbb to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230211fe74d368a82c4d55a7ad6b69136e2bbb 2023-02-11 19:55:53,892 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp/family2/217e2844f70e4411a522eb05d4f26057 2023-02-11 19:55:53,896 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp/family1/0bbd3bb6f58b4918b2375b75012c527f as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/0bbd3bb6f58b4918b2375b75012c527f 2023-02-11 19:55:53,899 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/0bbd3bb6f58b4918b2375b75012c527f, entries=4, sequenceid=17, filesize=5.4 K 2023-02-11 19:55:53,899 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp/family2/217e2844f70e4411a522eb05d4f26057 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/217e2844f70e4411a522eb05d4f26057 2023-02-11 19:55:53,902 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/217e2844f70e4411a522eb05d4f26057, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 19:55:53,903 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 6812f076b430f985f8f3eb44f6e4404b in 1650ms, sequenceid=17, compaction requested=true 2023-02-11 19:55:53,903 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6812f076b430f985f8f3eb44f6e4404b: 2023-02-11 19:55:53,903 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:55:53,903 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 19:55:53,903 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 19:55:53,903 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:53,904 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-11 19:55:53,904 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-11 19:55:53,905 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:53,905 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:53,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:53,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:53,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:53,905 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:53,905 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:55:53,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:53,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:53,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:53,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:53,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:53,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-11 19:55:53,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@539e88da[Count = 0] remaining members to acquire global barrier 2023-02-11 19:55:53,907 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-11 19:55:53,907 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:53,908 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:53,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:53,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:53,908 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-11 19:55:53,908 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-11 19:55:53,908 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:55:53,908 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:53,908 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:55:53,910 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-11 19:55:53,910 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:53,910 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:53,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:53,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:53,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:53,911 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-11 19:55:53,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:53,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:53,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:53,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:53,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:53,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:53,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:53,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:55:53,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-11 19:55:53,913 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-11 19:55:53,913 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:55:53,913 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:55:53,913 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-11 19:55:53,913 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:55:53,915 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:53,915 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:53,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:53,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:53,915 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:53,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:53,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:53,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:53,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:53,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:53,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:53,915 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:53,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:53,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:53,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:53,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:53,916 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:53,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:53,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:53,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:53,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:53,918 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:53,918 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:53,918 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:53,919 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:53,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:53,919 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:53,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:53,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-11 19:55:53,919 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-11 19:55:53,919 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:55:53,919 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:53,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:53,919 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:53,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:53,919 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:53,919 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:53,919 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:53,920 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-11 19:55:53,920 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:55:54,020 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:55:54,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:55:54,033 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 19:55:54,044 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 19:55:54,054 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 19:55:54,055 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 19:55:54,082 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:55:54,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-11 19:55:54,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-11 19:55:54,084 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-11 19:55:54,084 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:54,084 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-11 19:55:54,084 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-11 19:55:54,085 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:54,085 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:54,086 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:54,086 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:54,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:54,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:54,086 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:54,086 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:55:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:54,087 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:55:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:54,087 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-11 19:55:54,088 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-11 19:55:54,088 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-11 19:55:54,088 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-11 19:55:54,088 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:55:54,088 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-11 19:55:54,088 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:55:54,088 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:55:54,088 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. started... 2023-02-11 19:55:54,088 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 19:55:54,088 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:55:54,088 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6812f076b430f985f8f3eb44f6e4404b 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 19:55:54,088 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:55:54,088 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. started... 2023-02-11 19:55:54,089 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. started... 2023-02-11 19:55:54,089 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 4d3bfd92285822c834526e098976e53c 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 19:55:54,089 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 80bcde05173896e6ceb86130796e3c57 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 19:55:54,120 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp/family1/0c841b29a1e54414bc680c1b562b05b3 2023-02-11 19:55:54,123 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c841b29a1e54414bc680c1b562b05b3 2023-02-11 19:55:54,522 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp/family1/1a7c46dae8fe4a8d8af4b49951513722 2023-02-11 19:55:54,525 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a7c46dae8fe4a8d8af4b49951513722 2023-02-11 19:55:54,534 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp/family2/c18f4a98ff6046cbab1c4d63eb9b1608 2023-02-11 19:55:54,537 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c18f4a98ff6046cbab1c4d63eb9b1608 2023-02-11 19:55:54,537 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp/family1/0c841b29a1e54414bc680c1b562b05b3 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/0c841b29a1e54414bc680c1b562b05b3 2023-02-11 19:55:54,540 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c841b29a1e54414bc680c1b562b05b3 2023-02-11 19:55:54,540 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/0c841b29a1e54414bc680c1b562b05b3, entries=3, sequenceid=23, filesize=5.0 K 2023-02-11 19:55:54,541 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp/family2/c18f4a98ff6046cbab1c4d63eb9b1608 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/c18f4a98ff6046cbab1c4d63eb9b1608 2023-02-11 19:55:54,544 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c18f4a98ff6046cbab1c4d63eb9b1608 2023-02-11 19:55:54,544 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/c18f4a98ff6046cbab1c4d63eb9b1608, entries=1, sequenceid=23, filesize=5.0 K 2023-02-11 19:55:54,544 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 4d3bfd92285822c834526e098976e53c in 455ms, sequenceid=23, compaction requested=true 2023-02-11 19:55:54,544 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4d3bfd92285822c834526e098976e53c: 2023-02-11 19:55:54,544 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:55:54,545 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 19:55:54,912 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp/family1/b8f74be2ed3f48f8ae0fdc929e339157 2023-02-11 19:55:54,919 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b8f74be2ed3f48f8ae0fdc929e339157 2023-02-11 19:55:55,335 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp/family2/561e8081b548456b826ebc6f3df85ace 2023-02-11 19:55:55,338 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 561e8081b548456b826ebc6f3df85ace 2023-02-11 19:55:55,339 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp/family1/1a7c46dae8fe4a8d8af4b49951513722 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/1a7c46dae8fe4a8d8af4b49951513722 2023-02-11 19:55:55,342 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a7c46dae8fe4a8d8af4b49951513722 2023-02-11 19:55:55,342 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/1a7c46dae8fe4a8d8af4b49951513722, entries=3, sequenceid=23, filesize=5.0 K 2023-02-11 19:55:55,342 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp/family2/561e8081b548456b826ebc6f3df85ace as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/561e8081b548456b826ebc6f3df85ace 2023-02-11 19:55:55,345 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 561e8081b548456b826ebc6f3df85ace 2023-02-11 19:55:55,346 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/561e8081b548456b826ebc6f3df85ace, entries=1, sequenceid=23, filesize=5.0 K 2023-02-11 19:55:55,346 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 80bcde05173896e6ceb86130796e3c57 in 1257ms, sequenceid=23, compaction requested=true 2023-02-11 19:55:55,346 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 80bcde05173896e6ceb86130796e3c57: 2023-02-11 19:55:55,346 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:55:55,346 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 19:55:55,735 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp/family2/d329d822f44047d8a18655d369871483 2023-02-11 19:55:55,742 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d329d822f44047d8a18655d369871483 2023-02-11 19:55:55,743 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp/family1/b8f74be2ed3f48f8ae0fdc929e339157 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/b8f74be2ed3f48f8ae0fdc929e339157 2023-02-11 19:55:55,746 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b8f74be2ed3f48f8ae0fdc929e339157 2023-02-11 19:55:55,746 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/b8f74be2ed3f48f8ae0fdc929e339157, entries=3, sequenceid=23, filesize=5.0 K 2023-02-11 19:55:55,747 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp/family2/d329d822f44047d8a18655d369871483 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/d329d822f44047d8a18655d369871483 2023-02-11 19:55:55,766 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d329d822f44047d8a18655d369871483 2023-02-11 19:55:55,766 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/d329d822f44047d8a18655d369871483, entries=1, sequenceid=23, filesize=5.0 K 2023-02-11 19:55:55,767 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 6812f076b430f985f8f3eb44f6e4404b in 1679ms, sequenceid=23, compaction requested=true 2023-02-11 19:55:55,767 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6812f076b430f985f8f3eb44f6e4404b: 2023-02-11 19:55:55,767 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:55:55,767 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 19:55:55,767 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 19:55:55,767 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:55,767 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-11 19:55:55,767 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-11 19:55:55,770 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:55,770 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:55,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:55,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:55,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:55,770 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:55,770 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:55:55,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:55,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:55,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:55,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:55,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:55,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-11 19:55:55,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@de3d659[Count = 0] remaining members to acquire global barrier 2023-02-11 19:55:55,772 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-11 19:55:55,772 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:55,773 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:55,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:55,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:55,773 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-11 19:55:55,773 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-11 19:55:55,773 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:55:55,773 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:55,773 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:55:55,777 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-11 19:55:55,777 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:55,777 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:55,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:55,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:55,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:55,777 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-11 19:55:55,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:55,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:55,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:55,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:55,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:55,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:55,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:55,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:55:55,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-11 19:55:55,779 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-11 19:55:55,780 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:55:55,780 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:55:55,780 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-11 19:55:55,780 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:55:55,781 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:55,781 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:55,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:55,781 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:55,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:55,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:55,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:55:55,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:55:55,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:55,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:55,782 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:55,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:55:55,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:55,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:55,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:55:55,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:55,783 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:55,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:55,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:55:55,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 19:55:55,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:55,785 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:55,785 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:55:55,785 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:55,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:55:55,785 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-11 19:55:55,785 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:55:55,785 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-11 19:55:55,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:55:55,785 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:55:55,785 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 19:55:55,785 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-11 19:55:55,785 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:55:55,785 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:55:55,785 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:55:55,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:55:55,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:55:55,785 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:55,785 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 19:55:55,785 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 19:55:55,885 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:55:55,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:55:55,887 DEBUG [Listener at localhost/32929] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 19:55:55,887 DEBUG [Listener at localhost/32929] regionserver.HStore(1912): 6812f076b430f985f8f3eb44f6e4404b/family1 is initiating major compaction (all files) 2023-02-11 19:55:55,887 INFO [Listener at localhost/32929] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:55:55,887 INFO [Listener at localhost/32929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:55:55,887 INFO [Listener at localhost/32929] regionserver.HRegion(2258): Starting compaction of 6812f076b430f985f8f3eb44f6e4404b/family1 in ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:55:55,887 INFO [Listener at localhost/32929] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/9f56eb5abca74f58842bf4fc1ab4f71d, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/d398edb8432b44c6b625b2996f3d5eb5, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/0c8faec5126943c88cb793e35be67438, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/0bbd3bb6f58b4918b2375b75012c527f, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/b8f74be2ed3f48f8ae0fdc929e339157] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp, totalSize=26.6 K 2023-02-11 19:55:55,889 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 9f56eb5abca74f58842bf4fc1ab4f71d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145347236 2023-02-11 19:55:55,890 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting d398edb8432b44c6b625b2996f3d5eb5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145349034 2023-02-11 19:55:55,891 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 0c8faec5126943c88cb793e35be67438, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145350832 2023-02-11 19:55:55,891 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 0bbd3bb6f58b4918b2375b75012c527f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145352241 2023-02-11 19:55:55,892 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting b8f74be2ed3f48f8ae0fdc929e339157, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 19:55:55,912 INFO [Listener at localhost/32929] throttle.PressureAwareThroughputController(145): 6812f076b430f985f8f3eb44f6e4404b#family1#compaction#150 average throughput is 0.28 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:55:56,323 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230211ce043787102a4696b8009058df708619_del 2023-02-11 19:55:56,323 INFO [Listener at localhost/32929] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211ce043787102a4696b8009058df708619_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230211ce043787102a4696b8009058df708619_del 2023-02-11 19:55:57,135 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9fdba91d398e4a3f890a2c21dc91b470 2023-02-11 19:55:57,135 DEBUG [Listener at localhost/32929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp/family1/9fdba91d398e4a3f890a2c21dc91b470 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/9fdba91d398e4a3f890a2c21dc91b470 2023-02-11 19:55:57,138 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9fdba91d398e4a3f890a2c21dc91b470 2023-02-11 19:55:57,139 INFO [Listener at localhost/32929] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6812f076b430f985f8f3eb44f6e4404b/family1 of 6812f076b430f985f8f3eb44f6e4404b into 9fdba91d398e4a3f890a2c21dc91b470(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 19:55:57,139 DEBUG [Listener at localhost/32929] regionserver.HRegion(2288): Compaction status journal for 6812f076b430f985f8f3eb44f6e4404b: 2023-02-11 19:55:57,139 DEBUG [Listener at localhost/32929] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 19:55:57,139 DEBUG [Listener at localhost/32929] regionserver.HStore(1912): 6812f076b430f985f8f3eb44f6e4404b/family2 is initiating major compaction (all files) 2023-02-11 19:55:57,139 INFO [Listener at localhost/32929] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:55:57,139 INFO [Listener at localhost/32929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:55:57,140 INFO [Listener at localhost/32929] regionserver.HRegion(2258): Starting compaction of 6812f076b430f985f8f3eb44f6e4404b/family2 in ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:55:57,140 INFO [Listener at localhost/32929] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/a4466a48a3664e8a8bccb2913c8340a2, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/5a9f748b4d34487d98271f0cbe0946e0, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/eab1cdce697147159b14e872d31603f3, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/217e2844f70e4411a522eb05d4f26057, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/d329d822f44047d8a18655d369871483] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp, totalSize=25.3 K 2023-02-11 19:55:57,141 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting a4466a48a3664e8a8bccb2913c8340a2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145347236 2023-02-11 19:55:57,141 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 5a9f748b4d34487d98271f0cbe0946e0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145349034 2023-02-11 19:55:57,141 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting eab1cdce697147159b14e872d31603f3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145350832 2023-02-11 19:55:57,141 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 217e2844f70e4411a522eb05d4f26057, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145352241 2023-02-11 19:55:57,142 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting d329d822f44047d8a18655d369871483, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 19:55:57,148 INFO [Listener at localhost/32929] throttle.PressureAwareThroughputController(145): 6812f076b430f985f8f3eb44f6e4404b#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:55:57,234 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/9f56eb5abca74f58842bf4fc1ab4f71d, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/d398edb8432b44c6b625b2996f3d5eb5, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/0c8faec5126943c88cb793e35be67438, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/0bbd3bb6f58b4918b2375b75012c527f, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/b8f74be2ed3f48f8ae0fdc929e339157] to archive 2023-02-11 19:55:57,235 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:57,237 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/9f56eb5abca74f58842bf4fc1ab4f71d to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/9f56eb5abca74f58842bf4fc1ab4f71d 2023-02-11 19:55:57,238 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/d398edb8432b44c6b625b2996f3d5eb5 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/d398edb8432b44c6b625b2996f3d5eb5 2023-02-11 19:55:57,239 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/0c8faec5126943c88cb793e35be67438 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/0c8faec5126943c88cb793e35be67438 2023-02-11 19:55:57,240 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/0bbd3bb6f58b4918b2375b75012c527f to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/0bbd3bb6f58b4918b2375b75012c527f 2023-02-11 19:55:57,241 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/b8f74be2ed3f48f8ae0fdc929e339157 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/b8f74be2ed3f48f8ae0fdc929e339157 2023-02-11 19:55:57,556 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023021178625f947cae47e39c6f4be9e0ce1770_del 2023-02-11 19:55:57,556 INFO [Listener at localhost/32929] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021178625f947cae47e39c6f4be9e0ce1770_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023021178625f947cae47e39c6f4be9e0ce1770_del 2023-02-11 19:55:58,369 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3bc5a9b48d4a43cd8c163fc118301f22 2023-02-11 19:55:58,369 DEBUG [Listener at localhost/32929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/.tmp/family2/3bc5a9b48d4a43cd8c163fc118301f22 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/3bc5a9b48d4a43cd8c163fc118301f22 2023-02-11 19:55:58,373 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3bc5a9b48d4a43cd8c163fc118301f22 2023-02-11 19:55:58,374 INFO [Listener at localhost/32929] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6812f076b430f985f8f3eb44f6e4404b/family2 of 6812f076b430f985f8f3eb44f6e4404b into 3bc5a9b48d4a43cd8c163fc118301f22(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 19:55:58,374 DEBUG [Listener at localhost/32929] regionserver.HRegion(2288): Compaction status journal for 6812f076b430f985f8f3eb44f6e4404b: 2023-02-11 19:55:58,375 DEBUG [Listener at localhost/32929] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 19:55:58,375 DEBUG [Listener at localhost/32929] regionserver.HStore(1912): 4d3bfd92285822c834526e098976e53c/family1 is initiating major compaction (all files) 2023-02-11 19:55:58,375 INFO [Listener at localhost/32929] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:55:58,375 INFO [Listener at localhost/32929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:55:58,375 INFO [Listener at localhost/32929] regionserver.HRegion(2258): Starting compaction of 4d3bfd92285822c834526e098976e53c/family1 in ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:55:58,375 INFO [Listener at localhost/32929] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/37866ca18dc549b6922032b10d6a90bf, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/356686d997ba48a1ae541c67162d6e3c, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/6df166328d6e4d47a239d3ddeb137efb, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/0c4eb23c08954d149dd1b10c774b3e7f, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/0c841b29a1e54414bc680c1b562b05b3] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp, totalSize=26.6 K 2023-02-11 19:55:58,376 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 37866ca18dc549b6922032b10d6a90bf, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145347235 2023-02-11 19:55:58,376 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 356686d997ba48a1ae541c67162d6e3c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145349033 2023-02-11 19:55:58,377 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 6df166328d6e4d47a239d3ddeb137efb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145350831 2023-02-11 19:55:58,377 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 0c4eb23c08954d149dd1b10c774b3e7f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145352240 2023-02-11 19:55:58,377 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 0c841b29a1e54414bc680c1b562b05b3, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 19:55:58,386 INFO [Listener at localhost/32929] throttle.PressureAwareThroughputController(145): 4d3bfd92285822c834526e098976e53c#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:55:58,434 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/a4466a48a3664e8a8bccb2913c8340a2, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/5a9f748b4d34487d98271f0cbe0946e0, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/eab1cdce697147159b14e872d31603f3, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/217e2844f70e4411a522eb05d4f26057, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/d329d822f44047d8a18655d369871483] to archive 2023-02-11 19:55:58,435 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:58,437 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/a4466a48a3664e8a8bccb2913c8340a2 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/a4466a48a3664e8a8bccb2913c8340a2 2023-02-11 19:55:58,438 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/5a9f748b4d34487d98271f0cbe0946e0 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/5a9f748b4d34487d98271f0cbe0946e0 2023-02-11 19:55:58,439 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/eab1cdce697147159b14e872d31603f3 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/eab1cdce697147159b14e872d31603f3 2023-02-11 19:55:58,440 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/217e2844f70e4411a522eb05d4f26057 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/217e2844f70e4411a522eb05d4f26057 2023-02-11 19:55:58,441 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/d329d822f44047d8a18655d369871483 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family2/d329d822f44047d8a18655d369871483 2023-02-11 19:55:58,794 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230211b2b6e55b4eb048eaa258132837befdcd_del 2023-02-11 19:55:58,794 INFO [Listener at localhost/32929] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211b2b6e55b4eb048eaa258132837befdcd_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230211b2b6e55b4eb048eaa258132837befdcd_del 2023-02-11 19:55:59,611 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6b464372220e4803a68151d39122963e 2023-02-11 19:55:59,612 DEBUG [Listener at localhost/32929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp/family1/6b464372220e4803a68151d39122963e as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/6b464372220e4803a68151d39122963e 2023-02-11 19:55:59,617 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6b464372220e4803a68151d39122963e 2023-02-11 19:55:59,624 INFO [Listener at localhost/32929] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4d3bfd92285822c834526e098976e53c/family1 of 4d3bfd92285822c834526e098976e53c into 6b464372220e4803a68151d39122963e(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 19:55:59,625 DEBUG [Listener at localhost/32929] regionserver.HRegion(2288): Compaction status journal for 4d3bfd92285822c834526e098976e53c: 2023-02-11 19:55:59,625 DEBUG [Listener at localhost/32929] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 19:55:59,625 DEBUG [Listener at localhost/32929] regionserver.HStore(1912): 4d3bfd92285822c834526e098976e53c/family2 is initiating major compaction (all files) 2023-02-11 19:55:59,625 INFO [Listener at localhost/32929] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:55:59,625 INFO [Listener at localhost/32929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:55:59,627 INFO [Listener at localhost/32929] regionserver.HRegion(2258): Starting compaction of 4d3bfd92285822c834526e098976e53c/family2 in ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:55:59,627 INFO [Listener at localhost/32929] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/dc1a90e525eb46d585cbaaf3a1655c84, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/1690561216594909b698a8c10addbaae, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/bbc0cbdc5fb54bc19563381217d5a4ed, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/cd0b66aab8e14ad3a7b9674c6477987f, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/c18f4a98ff6046cbab1c4d63eb9b1608] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp, totalSize=25.3 K 2023-02-11 19:55:59,628 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting dc1a90e525eb46d585cbaaf3a1655c84, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145347235 2023-02-11 19:55:59,628 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 1690561216594909b698a8c10addbaae, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145349033 2023-02-11 19:55:59,628 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting bbc0cbdc5fb54bc19563381217d5a4ed, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145350831 2023-02-11 19:55:59,629 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting cd0b66aab8e14ad3a7b9674c6477987f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145352240 2023-02-11 19:55:59,629 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting c18f4a98ff6046cbab1c4d63eb9b1608, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 19:55:59,634 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/37866ca18dc549b6922032b10d6a90bf, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/356686d997ba48a1ae541c67162d6e3c, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/6df166328d6e4d47a239d3ddeb137efb, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/0c4eb23c08954d149dd1b10c774b3e7f, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/0c841b29a1e54414bc680c1b562b05b3] to archive 2023-02-11 19:55:59,635 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:55:59,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/37866ca18dc549b6922032b10d6a90bf to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/37866ca18dc549b6922032b10d6a90bf 2023-02-11 19:55:59,638 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/356686d997ba48a1ae541c67162d6e3c to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/356686d997ba48a1ae541c67162d6e3c 2023-02-11 19:55:59,640 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/6df166328d6e4d47a239d3ddeb137efb to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/6df166328d6e4d47a239d3ddeb137efb 2023-02-11 19:55:59,641 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/0c4eb23c08954d149dd1b10c774b3e7f to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/0c4eb23c08954d149dd1b10c774b3e7f 2023-02-11 19:55:59,643 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/0c841b29a1e54414bc680c1b562b05b3 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/0c841b29a1e54414bc680c1b562b05b3 2023-02-11 19:55:59,647 INFO [Listener at localhost/32929] throttle.PressureAwareThroughputController(145): 4d3bfd92285822c834526e098976e53c#family2#compaction#153 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:55:59,663 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230211bbc4f2a09129452981dc6f0327e7f04d_del 2023-02-11 19:55:59,663 INFO [Listener at localhost/32929] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211bbc4f2a09129452981dc6f0327e7f04d_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230211bbc4f2a09129452981dc6f0327e7f04d_del 2023-02-11 19:56:00,077 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 018d0ea2807648bd8c7bae415f9f27cd 2023-02-11 19:56:00,078 DEBUG [Listener at localhost/32929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/.tmp/family2/018d0ea2807648bd8c7bae415f9f27cd as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/018d0ea2807648bd8c7bae415f9f27cd 2023-02-11 19:56:00,083 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 018d0ea2807648bd8c7bae415f9f27cd 2023-02-11 19:56:00,084 INFO [Listener at localhost/32929] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4d3bfd92285822c834526e098976e53c/family2 of 4d3bfd92285822c834526e098976e53c into 018d0ea2807648bd8c7bae415f9f27cd(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 19:56:00,084 DEBUG [Listener at localhost/32929] regionserver.HRegion(2288): Compaction status journal for 4d3bfd92285822c834526e098976e53c: 2023-02-11 19:56:00,084 DEBUG [Listener at localhost/32929] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 19:56:00,084 DEBUG [Listener at localhost/32929] regionserver.HStore(1912): 80bcde05173896e6ceb86130796e3c57/family1 is initiating major compaction (all files) 2023-02-11 19:56:00,084 INFO [Listener at localhost/32929] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:56:00,084 INFO [Listener at localhost/32929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:56:00,085 INFO [Listener at localhost/32929] regionserver.HRegion(2258): Starting compaction of 80bcde05173896e6ceb86130796e3c57/family1 in ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:56:00,085 INFO [Listener at localhost/32929] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/0598d061961440ab9f309c856ecad3fc, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/811fa1e213144bae8a8d2f6c894d6479, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/4471d377ed06433d89ae86e1175ddef9, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/090ff36cf97e41d7bc3b98ad7c695a0c, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/1a7c46dae8fe4a8d8af4b49951513722] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp, totalSize=26.6 K 2023-02-11 19:56:00,085 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 0598d061961440ab9f309c856ecad3fc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145347236 2023-02-11 19:56:00,086 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 811fa1e213144bae8a8d2f6c894d6479, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145349034 2023-02-11 19:56:00,086 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 4471d377ed06433d89ae86e1175ddef9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145350832 2023-02-11 19:56:00,087 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 090ff36cf97e41d7bc3b98ad7c695a0c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145352240 2023-02-11 19:56:00,087 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 1a7c46dae8fe4a8d8af4b49951513722, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 19:56:00,108 INFO [Listener at localhost/32929] throttle.PressureAwareThroughputController(145): 80bcde05173896e6ceb86130796e3c57#family1#compaction#154 average throughput is 0.14 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:56:00,123 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302111de2bfc8ff2a4db28c01f5f20c29226a_del 2023-02-11 19:56:00,123 INFO [Listener at localhost/32929] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302111de2bfc8ff2a4db28c01f5f20c29226a_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302111de2bfc8ff2a4db28c01f5f20c29226a_del 2023-02-11 19:56:00,134 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/dc1a90e525eb46d585cbaaf3a1655c84, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/1690561216594909b698a8c10addbaae, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/bbc0cbdc5fb54bc19563381217d5a4ed, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/cd0b66aab8e14ad3a7b9674c6477987f, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/c18f4a98ff6046cbab1c4d63eb9b1608] to archive 2023-02-11 19:56:00,135 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:56:00,139 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/dc1a90e525eb46d585cbaaf3a1655c84 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/dc1a90e525eb46d585cbaaf3a1655c84 2023-02-11 19:56:00,141 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/1690561216594909b698a8c10addbaae to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/1690561216594909b698a8c10addbaae 2023-02-11 19:56:00,147 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/bbc0cbdc5fb54bc19563381217d5a4ed to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/bbc0cbdc5fb54bc19563381217d5a4ed 2023-02-11 19:56:00,148 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/cd0b66aab8e14ad3a7b9674c6477987f to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/cd0b66aab8e14ad3a7b9674c6477987f 2023-02-11 19:56:00,150 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/c18f4a98ff6046cbab1c4d63eb9b1608 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family2/c18f4a98ff6046cbab1c4d63eb9b1608 2023-02-11 19:56:00,551 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e5e2c4d7426f4bf7a1303f43b059f860 2023-02-11 19:56:00,551 DEBUG [Listener at localhost/32929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp/family1/e5e2c4d7426f4bf7a1303f43b059f860 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/e5e2c4d7426f4bf7a1303f43b059f860 2023-02-11 19:56:00,556 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e5e2c4d7426f4bf7a1303f43b059f860 2023-02-11 19:56:00,558 INFO [Listener at localhost/32929] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 80bcde05173896e6ceb86130796e3c57/family1 of 80bcde05173896e6ceb86130796e3c57 into e5e2c4d7426f4bf7a1303f43b059f860(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 19:56:00,558 DEBUG [Listener at localhost/32929] regionserver.HRegion(2288): Compaction status journal for 80bcde05173896e6ceb86130796e3c57: 2023-02-11 19:56:00,558 DEBUG [Listener at localhost/32929] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 19:56:00,558 DEBUG [Listener at localhost/32929] regionserver.HStore(1912): 80bcde05173896e6ceb86130796e3c57/family2 is initiating major compaction (all files) 2023-02-11 19:56:00,558 INFO [Listener at localhost/32929] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:56:00,558 INFO [Listener at localhost/32929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:56:00,559 INFO [Listener at localhost/32929] regionserver.HRegion(2258): Starting compaction of 80bcde05173896e6ceb86130796e3c57/family2 in ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:56:00,559 INFO [Listener at localhost/32929] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/2848c32c25154896b539666148ab49c3, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/2807f3d9451446db9a4c14d9a30d915a, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/07add2497f2f4c478f2df85cf4957c45, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/89242340d8bc4ef7a33be022d25c1391, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/561e8081b548456b826ebc6f3df85ace] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp, totalSize=25.3 K 2023-02-11 19:56:00,560 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 2848c32c25154896b539666148ab49c3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145347236 2023-02-11 19:56:00,560 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 2807f3d9451446db9a4c14d9a30d915a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145349034 2023-02-11 19:56:00,561 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 07add2497f2f4c478f2df85cf4957c45, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145350832 2023-02-11 19:56:00,561 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 89242340d8bc4ef7a33be022d25c1391, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145352240 2023-02-11 19:56:00,561 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 561e8081b548456b826ebc6f3df85ace, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 19:56:00,574 INFO [Listener at localhost/32929] throttle.PressureAwareThroughputController(145): 80bcde05173896e6ceb86130796e3c57#family2#compaction#155 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:56:00,634 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/0598d061961440ab9f309c856ecad3fc, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/811fa1e213144bae8a8d2f6c894d6479, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/4471d377ed06433d89ae86e1175ddef9, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/090ff36cf97e41d7bc3b98ad7c695a0c, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/1a7c46dae8fe4a8d8af4b49951513722] to archive 2023-02-11 19:56:00,635 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:56:00,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/0598d061961440ab9f309c856ecad3fc to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/0598d061961440ab9f309c856ecad3fc 2023-02-11 19:56:00,638 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/811fa1e213144bae8a8d2f6c894d6479 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/811fa1e213144bae8a8d2f6c894d6479 2023-02-11 19:56:00,639 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/4471d377ed06433d89ae86e1175ddef9 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/4471d377ed06433d89ae86e1175ddef9 2023-02-11 19:56:00,641 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/090ff36cf97e41d7bc3b98ad7c695a0c to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/090ff36cf97e41d7bc3b98ad7c695a0c 2023-02-11 19:56:00,642 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/1a7c46dae8fe4a8d8af4b49951513722 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/1a7c46dae8fe4a8d8af4b49951513722 2023-02-11 19:56:00,984 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230211246aa813cee74831a04930e06eb0811c_del 2023-02-11 19:56:00,984 INFO [Listener at localhost/32929] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211246aa813cee74831a04930e06eb0811c_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230211246aa813cee74831a04930e06eb0811c_del 2023-02-11 19:56:01,799 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9f45b70e82624a31a706f88f580647cc 2023-02-11 19:56:01,800 DEBUG [Listener at localhost/32929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/.tmp/family2/9f45b70e82624a31a706f88f580647cc as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/9f45b70e82624a31a706f88f580647cc 2023-02-11 19:56:01,803 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9f45b70e82624a31a706f88f580647cc 2023-02-11 19:56:01,804 INFO [Listener at localhost/32929] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 80bcde05173896e6ceb86130796e3c57/family2 of 80bcde05173896e6ceb86130796e3c57 into 9f45b70e82624a31a706f88f580647cc(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 19:56:01,805 DEBUG [Listener at localhost/32929] regionserver.HRegion(2288): Compaction status journal for 80bcde05173896e6ceb86130796e3c57: 2023-02-11 19:56:01,808 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 19:56:01,811 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 19:56:01,814 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 19:56:01,815 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 19:56:01,821 INFO [Listener at localhost/32929] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-11 19:56:01,834 INFO [Listener at localhost/32929] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-02-11 19:56:01,837 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230211b2b6e55b4eb048eaa258132837befdcd_del 2023-02-11 19:56:01,839 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/2848c32c25154896b539666148ab49c3, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/2807f3d9451446db9a4c14d9a30d915a, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/07add2497f2f4c478f2df85cf4957c45, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/89242340d8bc4ef7a33be022d25c1391, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/561e8081b548456b826ebc6f3df85ace] to archive 2023-02-11 19:56:01,840 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302111de2bfc8ff2a4db28c01f5f20c29226a_del 2023-02-11 19:56:01,840 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:56:01,842 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/2848c32c25154896b539666148ab49c3 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/2848c32c25154896b539666148ab49c3 2023-02-11 19:56:01,843 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/2807f3d9451446db9a4c14d9a30d915a to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/2807f3d9451446db9a4c14d9a30d915a 2023-02-11 19:56:01,844 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/07add2497f2f4c478f2df85cf4957c45 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/07add2497f2f4c478f2df85cf4957c45 2023-02-11 19:56:01,846 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230211ce043787102a4696b8009058df708619_del 2023-02-11 19:56:01,846 INFO [Listener at localhost/32929] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-02-11 19:56:01,847 DEBUG [Listener at localhost/32929] zookeeper.ReadOnlyZKClient(139): Connect 0x1774f383 to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:56:01,850 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/89242340d8bc4ef7a33be022d25c1391 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/89242340d8bc4ef7a33be022d25c1391 2023-02-11 19:56:01,852 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/561e8081b548456b826ebc6f3df85ace to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family2/561e8081b548456b826ebc6f3df85ace 2023-02-11 19:56:01,858 DEBUG [Listener at localhost/32929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52f9b8b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:56:01,859 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230211 for table='ns:testMinorCompaction' and column='family1' 2023-02-11 19:56:01,859 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230211 for table='ns:testMinorCompaction' and column='family1' 2023-02-11 19:56:01,859 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230211 for table='ns:testMinorCompaction' and column='family1' 2023-02-11 19:56:02,292 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302114d19b81543754b2ab275a60b18e1fc40 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302114d19b81543754b2ab275a60b18e1fc40 2023-02-11 19:56:02,293 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='ns:testMinorCompaction' column='family1' 2023-02-11 19:56:02,295 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211d0448dc78b4d46a6bde725adad15981b to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230211d0448dc78b4d46a6bde725adad15981b 2023-02-11 19:56:02,296 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='ns:testMinorCompaction' column='family1' 2023-02-11 19:56:02,299 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302116922850531dc49ec910aa293f7836899 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302116922850531dc49ec910aa293f7836899 2023-02-11 19:56:02,300 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='ns:testMinorCompaction' column='family1' 2023-02-11 19:56:02,306 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:56:02,310 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49120, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:56:02,327 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:56:02,331 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48916, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:56:02,345 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/family1/50d5a7ababcf4dedbab51373ed3fc00c first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-02-11 19:56:02,348 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/family1/50d5a7ababcf4dedbab51373ed3fc00c}] 2023-02-11 19:56:02,351 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230211/family1/ac45915cf69f493ab2fc678be4458bb1 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-02-11 19:56:02,353 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230211/family1/ac45915cf69f493ab2fc678be4458bb1}] 2023-02-11 19:56:02,354 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230211/family1/6e36d7a4036e4495ba478da1532df854 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-02-11 19:56:02,355 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230211/family1/6e36d7a4036e4495ba478da1532df854}] 2023-02-11 19:56:02,356 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/family1/50d5a7ababcf4dedbab51373ed3fc00c for inclusion in 4d3bfd92285822c834526e098976e53c/family1 2023-02-11 19:56:02,357 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230211/family1/ac45915cf69f493ab2fc678be4458bb1 for inclusion in 6812f076b430f985f8f3eb44f6e4404b/family1 2023-02-11 19:56:02,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230211/family1/6e36d7a4036e4495ba478da1532df854 for inclusion in 80bcde05173896e6ceb86130796e3c57/family1 2023-02-11 19:56:02,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-02-11 19:56:02,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last=1 2023-02-11 19:56:02,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 4d3bfd92285822c834526e098976e53c: 2023-02-11 19:56:02,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-02-11 19:56:02,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-11 19:56:02,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 6812f076b430f985f8f3eb44f6e4404b: 2023-02-11 19:56:02,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-02-11 19:56:02,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-11 19:56:02,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/family1/50d5a7ababcf4dedbab51373ed3fc00c to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__ns_testMinorCompaction__vpiil0fofale6k4s682nra6jf7hhnm7r8ufg851d6d5ugp2fn15jcs76bu794ihs/family1/50d5a7ababcf4dedbab51373ed3fc00c 2023-02-11 19:56:02,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 80bcde05173896e6ceb86130796e3c57: 2023-02-11 19:56:02,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230211/family1/ac45915cf69f493ab2fc678be4458bb1 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__ns_testMinorCompaction__3372dn7eejkbr7i9nt45dkrnch46hjafoutj743s8qcff3n39gc4vcpgdce3otbo/family1/ac45915cf69f493ab2fc678be4458bb1 2023-02-11 19:56:02,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230211/family1/6e36d7a4036e4495ba478da1532df854 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__ns_testMinorCompaction__vgp2mcuvmsp7p2p40v3klceuj3hmn829pm2n45vbkrdpsualf7p417p8aqbn5m1e/family1/6e36d7a4036e4495ba478da1532df854 2023-02-11 19:56:02,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__ns_testMinorCompaction__vpiil0fofale6k4s682nra6jf7hhnm7r8ufg851d6d5ugp2fn15jcs76bu794ihs/family1/50d5a7ababcf4dedbab51373ed3fc00c as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/99b3f52cc34f4350bfd953b406ac2ea2_SeqId_28_ 2023-02-11 19:56:02,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__ns_testMinorCompaction__3372dn7eejkbr7i9nt45dkrnch46hjafoutj743s8qcff3n39gc4vcpgdce3otbo/family1/ac45915cf69f493ab2fc678be4458bb1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/bdc8c35639514e95a3e8563ecbba7fce_SeqId_28_ 2023-02-11 19:56:02,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__ns_testMinorCompaction__vgp2mcuvmsp7p2p40v3klceuj3hmn829pm2n45vbkrdpsualf7p417p8aqbn5m1e/family1/6e36d7a4036e4495ba478da1532df854 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/717129ccea32435cbed0755a571b836d_SeqId_28_ 2023-02-11 19:56:02,366 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__ns_testMinorCompaction__vpiil0fofale6k4s682nra6jf7hhnm7r8ufg851d6d5ugp2fn15jcs76bu794ihs/family1/50d5a7ababcf4dedbab51373ed3fc00c into 4d3bfd92285822c834526e098976e53c/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/99b3f52cc34f4350bfd953b406ac2ea2_SeqId_28_ - updating store file list. 2023-02-11 19:56:02,366 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__ns_testMinorCompaction__3372dn7eejkbr7i9nt45dkrnch46hjafoutj743s8qcff3n39gc4vcpgdce3otbo/family1/ac45915cf69f493ab2fc678be4458bb1 into 6812f076b430f985f8f3eb44f6e4404b/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/bdc8c35639514e95a3e8563ecbba7fce_SeqId_28_ - updating store file list. 2023-02-11 19:56:02,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__ns_testMinorCompaction__vgp2mcuvmsp7p2p40v3klceuj3hmn829pm2n45vbkrdpsualf7p417p8aqbn5m1e/family1/6e36d7a4036e4495ba478da1532df854 into 80bcde05173896e6ceb86130796e3c57/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/717129ccea32435cbed0755a571b836d_SeqId_28_ - updating store file list. 2023-02-11 19:56:02,371 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/bdc8c35639514e95a3e8563ecbba7fce_SeqId_28_ into 6812f076b430f985f8f3eb44f6e4404b/family1 2023-02-11 19:56:02,371 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__ns_testMinorCompaction__3372dn7eejkbr7i9nt45dkrnch46hjafoutj743s8qcff3n39gc4vcpgdce3otbo/family1/ac45915cf69f493ab2fc678be4458bb1 into 6812f076b430f985f8f3eb44f6e4404b/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/family1/bdc8c35639514e95a3e8563ecbba7fce_SeqId_28_) 2023-02-11 19:56:02,371 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/99b3f52cc34f4350bfd953b406ac2ea2_SeqId_28_ into 4d3bfd92285822c834526e098976e53c/family1 2023-02-11 19:56:02,371 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__ns_testMinorCompaction__vpiil0fofale6k4s682nra6jf7hhnm7r8ufg851d6d5ugp2fn15jcs76bu794ihs/family1/50d5a7ababcf4dedbab51373ed3fc00c into 4d3bfd92285822c834526e098976e53c/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/family1/99b3f52cc34f4350bfd953b406ac2ea2_SeqId_28_) 2023-02-11 19:56:02,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/717129ccea32435cbed0755a571b836d_SeqId_28_ into 80bcde05173896e6ceb86130796e3c57/family1 2023-02-11 19:56:02,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__ns_testMinorCompaction__vgp2mcuvmsp7p2p40v3klceuj3hmn829pm2n45vbkrdpsualf7p417p8aqbn5m1e/family1/6e36d7a4036e4495ba478da1532df854 into 80bcde05173896e6ceb86130796e3c57/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/family1/717129ccea32435cbed0755a571b836d_SeqId_28_) 2023-02-11 19:56:02,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__ns_testMinorCompaction__vpiil0fofale6k4s682nra6jf7hhnm7r8ufg851d6d5ugp2fn15jcs76bu794ihs/family1/50d5a7ababcf4dedbab51373ed3fc00c 2023-02-11 19:56:02,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__ns_testMinorCompaction__3372dn7eejkbr7i9nt45dkrnch46hjafoutj743s8qcff3n39gc4vcpgdce3otbo/family1/ac45915cf69f493ab2fc678be4458bb1 2023-02-11 19:56:02,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__ns_testMinorCompaction__vgp2mcuvmsp7p2p40v3klceuj3hmn829pm2n45vbkrdpsualf7p417p8aqbn5m1e/family1/6e36d7a4036e4495ba478da1532df854 2023-02-11 19:56:02,374 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='ns:testMinorCompaction' column='family1' 2023-02-11 19:56:02,374 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='ns:testMinorCompaction' column='family1' 2023-02-11 19:56:02,374 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='ns:testMinorCompaction' column='family1' 2023-02-11 19:56:02,374 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:56:02,375 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:56:02,375 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:56:02,377 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302110a95e907e6f6462baea59d4305d06917 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302110a95e907e6f6462baea59d4305d06917 2023-02-11 19:56:02,377 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023021161a1f6bca37f4ea787980e446acec32a to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023021161a1f6bca37f4ea787980e446acec32a 2023-02-11 19:56:02,377 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230211f46e7fa1c4a542f29db722d1c8662e41 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230211f46e7fa1c4a542f29db722d1c8662e41 2023-02-11 19:56:02,377 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-11 19:56:02,377 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-11 19:56:02,377 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-11 19:56:02,377 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230211' 2023-02-11 19:56:02,377 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230211' 2023-02-11 19:56:02,377 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230211' 2023-02-11 19:56:02,378 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230211 for table='ns:testMinorCompaction' and column='family1' 2023-02-11 19:56:02,378 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230211 for table='ns:testMinorCompaction' and column='family1' 2023-02-11 19:56:02,378 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230211 for table='ns:testMinorCompaction' and column='family1' 2023-02-11 19:56:02,378 INFO [Listener at localhost/32929] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-02-11 19:56:02,381 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 19:56:02,383 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 19:56:02,386 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 19:56:02,387 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 19:56:02,410 INFO [Listener at localhost/32929] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=248 (was 286), OpenFileDescriptor=627 (was 764), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=231 (was 135) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3530 (was 3419) - AvailableMemoryMB LEAK? - 2023-02-11 19:56:02,427 INFO [Listener at localhost/32929] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=248, OpenFileDescriptor=627, MaxFileDescriptor=60000, SystemLoadAverage=231, ProcessCount=168, AvailableMemoryMB=3530 2023-02-11 19:56:02,429 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-11 19:56:02,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:02,431 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:56:02,431 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-02-11 19:56:02,432 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:56:02,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-11 19:56:02,434 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4 2023-02-11 19:56:02,434 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4 empty. 2023-02-11 19:56:02,435 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4 2023-02-11 19:56:02,435 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-02-11 19:56:02,446 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-11 19:56:02,448 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 02279d174624d22b1025401891d904b4, NAME => 'testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp 2023-02-11 19:56:02,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-11 19:56:02,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-11 19:56:02,854 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:56:02,854 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing 02279d174624d22b1025401891d904b4, disabling compactions & flushes 2023-02-11 19:56:02,854 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:02,854 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:02,854 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. after waiting 0 ms 2023-02-11 19:56:02,854 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:02,854 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:02,854 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 02279d174624d22b1025401891d904b4: Waiting for close lock at 1676145362854Disabling compacts and flushes for region at 1676145362854Disabling writes for close at 1676145362854Writing region close event to WAL at 1676145362854Closed at 1676145362854 2023-02-11 19:56:02,856 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:56:02,857 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676145362857"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145362857"}]},"ts":"1676145362857"} 2023-02-11 19:56:02,859 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 19:56:02,860 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:56:02,860 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145362860"}]},"ts":"1676145362860"} 2023-02-11 19:56:02,861 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-11 19:56:02,864 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=02279d174624d22b1025401891d904b4, ASSIGN}] 2023-02-11 19:56:02,865 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=02279d174624d22b1025401891d904b4, ASSIGN 2023-02-11 19:56:02,866 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=02279d174624d22b1025401891d904b4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=false 2023-02-11 19:56:03,017 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=02279d174624d22b1025401891d904b4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:03,017 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676145363017"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145363017"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145363017"}]},"ts":"1676145363017"} 2023-02-11 19:56:03,019 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 02279d174624d22b1025401891d904b4, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:56:03,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-11 19:56:03,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:03,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 02279d174624d22b1025401891d904b4, NAME => 'testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:56:03,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 02279d174624d22b1025401891d904b4 2023-02-11 19:56:03,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:56:03,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 02279d174624d22b1025401891d904b4 2023-02-11 19:56:03,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 02279d174624d22b1025401891d904b4 2023-02-11 19:56:03,175 INFO [StoreOpener-02279d174624d22b1025401891d904b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 02279d174624d22b1025401891d904b4 2023-02-11 19:56:03,176 DEBUG [StoreOpener-02279d174624d22b1025401891d904b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1 2023-02-11 19:56:03,176 DEBUG [StoreOpener-02279d174624d22b1025401891d904b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1 2023-02-11 19:56:03,176 INFO [StoreOpener-02279d174624d22b1025401891d904b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02279d174624d22b1025401891d904b4 columnFamilyName family1 2023-02-11 19:56:03,177 INFO [StoreOpener-02279d174624d22b1025401891d904b4-1] regionserver.HStore(310): Store=02279d174624d22b1025401891d904b4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:56:03,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4 2023-02-11 19:56:03,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4 2023-02-11 19:56:03,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 02279d174624d22b1025401891d904b4 2023-02-11 19:56:03,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:56:03,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 02279d174624d22b1025401891d904b4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67496043, jitterRate=0.005769416689872742}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:56:03,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 02279d174624d22b1025401891d904b4: Running coprocessor pre-open hook at 1676145363174Writing region info on filesystem at 1676145363174Initializing all the Stores at 1676145363174Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676145363174Cleaning up temporary data from old regions at 1676145363179 (+5 ms)Cleaning up detritus from prior splits at 1676145363179Running coprocessor post-open hooks at 1676145363182 (+3 ms)Region opened successfully at 1676145363182 2023-02-11 19:56:03,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4., pid=114, masterSystemTime=1676145363170 2023-02-11 19:56:03,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:03,184 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:03,184 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=02279d174624d22b1025401891d904b4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:03,185 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676145363184"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145363184"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145363184"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145363184"}]},"ts":"1676145363184"} 2023-02-11 19:56:03,187 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-02-11 19:56:03,187 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 02279d174624d22b1025401891d904b4, server=jenkins-hbase4.apache.org,45897,1676145215747 in 167 msec 2023-02-11 19:56:03,188 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-02-11 19:56:03,188 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=02279d174624d22b1025401891d904b4, ASSIGN in 323 msec 2023-02-11 19:56:03,188 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:56:03,188 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145363188"}]},"ts":"1676145363188"} 2023-02-11 19:56:03,189 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-11 19:56:03,192 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:56:03,193 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 763 msec 2023-02-11 19:56:03,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-11 19:56:03,537 INFO [Listener at localhost/32929] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-02-11 19:56:03,559 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:56:03,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,561 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 19:56:03,561 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:03,561 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 19:56:03,561 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 19:56:03,562 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,562 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,567 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:03,567 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:03,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:03,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:03,568 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:03,568 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:56:03,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,568 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:56:03,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,569 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,569 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,569 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 19:56:03,569 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:03,569 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 19:56:03,569 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:56:03,569 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:56:03,569 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:03,569 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. started... 2023-02-11 19:56:03,570 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 02279d174624d22b1025401891d904b4 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-11 19:56:03,598 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113009b80299b3d2426984c164c5dd45ce31 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113009b80299b3d2426984c164c5dd45ce31 2023-02-11 19:56:03,601 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp/family1/e99e73dc042c403dbfbae3a69f7462ed 2023-02-11 19:56:03,604 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp/family1/e99e73dc042c403dbfbae3a69f7462ed as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/e99e73dc042c403dbfbae3a69f7462ed 2023-02-11 19:56:03,608 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/e99e73dc042c403dbfbae3a69f7462ed, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-11 19:56:03,608 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 02279d174624d22b1025401891d904b4 in 38ms, sequenceid=5, compaction requested=false 2023-02-11 19:56:03,608 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 19:56:03,609 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 02279d174624d22b1025401891d904b4: 2023-02-11 19:56:03,609 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:03,609 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:56:03,609 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:56:03,609 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:03,609 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 19:56:03,609 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 19:56:03,611 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,611 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:03,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:03,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:03,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:03,611 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,611 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:56:03,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:03,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:03,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:03,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:03,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 19:56:03,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b0a1ae4[Count = 0] remaining members to acquire global barrier 2023-02-11 19:56:03,613 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 19:56:03,613 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,614 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,614 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:03,614 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:56:03,614 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 19:56:03,614 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 19:56:03,614 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:56:03,615 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:03,615 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 19:56:03,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:03,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:03,615 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:03,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:03,615 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 19:56:03,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:03,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:03,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:03,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:03,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:03,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:56:03,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:56:03,618 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 19:56:03,618 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:56:03,618 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:56:03,618 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,618 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:56:03,621 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,621 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:03,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:03,621 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:03,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:03,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:03,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:03,621 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:03,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:03,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:03,623 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:03,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:03,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:03,625 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:03,625 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:03,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:03,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:03,625 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:03,625 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,625 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 19:56:03,625 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:56:03,625 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:03,625 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,625 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:03,625 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,625 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,625 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:03,626 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:56:03,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:03,626 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:56:03,726 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:56:03,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:56:03,731 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:56:03,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:56:03,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,733 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 19:56:03,733 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:03,733 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 19:56:03,733 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 19:56:03,733 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,733 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,734 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:03,734 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:03,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:03,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:03,735 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:03,735 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:56:03,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:56:03,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,735 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,736 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 19:56:03,736 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:03,736 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 19:56:03,736 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:03,736 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 19:56:03,736 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:56:03,736 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:56:03,736 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:03,736 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. started... 2023-02-11 19:56:03,736 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 02279d174624d22b1025401891d904b4 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-11 19:56:04,147 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112802ffe19f8ee44fc3a43064215846f29b to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112802ffe19f8ee44fc3a43064215846f29b 2023-02-11 19:56:04,552 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp/family1/2bf11e00918143648f84bf556cac9ff8 2023-02-11 19:56:04,557 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp/family1/2bf11e00918143648f84bf556cac9ff8 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/2bf11e00918143648f84bf556cac9ff8 2023-02-11 19:56:04,561 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/2bf11e00918143648f84bf556cac9ff8, entries=1, sequenceid=9, filesize=5.0 K 2023-02-11 19:56:04,562 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 02279d174624d22b1025401891d904b4 in 826ms, sequenceid=9, compaction requested=false 2023-02-11 19:56:04,562 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 02279d174624d22b1025401891d904b4: 2023-02-11 19:56:04,562 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:04,562 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:56:04,562 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:56:04,562 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:04,562 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 19:56:04,562 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 19:56:04,564 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:04,564 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:04,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:04,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:04,564 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:04,564 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:56:04,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:04,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:04,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:04,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 19:56:04,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71294974[Count = 0] remaining members to acquire global barrier 2023-02-11 19:56:04,566 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 19:56:04,566 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,568 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,568 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 19:56:04,568 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 19:56:04,568 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:56:04,568 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:04,568 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:56:04,570 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 19:56:04,570 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:04,570 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:04,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:04,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:04,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:04,570 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 19:56:04,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:04,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:04,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:04,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:04,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:04,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:56:04,573 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:56:04,573 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 19:56:04,573 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:56:04,573 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:56:04,573 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,573 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:56:04,575 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,575 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,575 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:04,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:04,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:04,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:04,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:04,575 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:04,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:04,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:04,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,576 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:04,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:04,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:04,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:04,579 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:04,579 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,579 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,579 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:04,579 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,579 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:04,579 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 19:56:04,579 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:04,579 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:56:04,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:04,579 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:04,579 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:04,579 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:56:04,579 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,579 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:56:04,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:04,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:04,679 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:56:04,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:56:04,684 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:56:04,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:56:04,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,685 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 19:56:04,685 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:04,685 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 19:56:04,685 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 19:56:04,686 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,686 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,692 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:04,692 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:04,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:04,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:04,692 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:04,692 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:56:04,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,693 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:56:04,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,693 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,693 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 19:56:04,693 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:04,693 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 19:56:04,693 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:04,694 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 19:56:04,694 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:56:04,694 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:56:04,694 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:04,694 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. started... 2023-02-11 19:56:04,694 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 02279d174624d22b1025401891d904b4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:56:05,107 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201b6f33b84677a46d7a5892f609a9f1dc7 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201b6f33b84677a46d7a5892f609a9f1dc7 2023-02-11 19:56:05,113 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp/family1/72e8e988009746e8aca5cc9370232e57 2023-02-11 19:56:05,117 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp/family1/72e8e988009746e8aca5cc9370232e57 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/72e8e988009746e8aca5cc9370232e57 2023-02-11 19:56:05,122 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/72e8e988009746e8aca5cc9370232e57, entries=1, sequenceid=13, filesize=4.9 K 2023-02-11 19:56:05,123 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 02279d174624d22b1025401891d904b4 in 429ms, sequenceid=13, compaction requested=true 2023-02-11 19:56:05,123 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 02279d174624d22b1025401891d904b4: 2023-02-11 19:56:05,123 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:05,123 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:56:05,123 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:56:05,123 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:05,124 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 19:56:05,124 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 19:56:05,125 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:05,125 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:05,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:05,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:05,126 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,126 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:56:05,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:05,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:05,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:05,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:05,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 19:56:05,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56d6d7d3[Count = 0] remaining members to acquire global barrier 2023-02-11 19:56:05,127 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 19:56:05,127 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,129 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,129 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 19:56:05,129 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 19:56:05,129 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:56:05,129 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:05,129 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:56:05,130 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 19:56:05,130 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:05,130 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:05,130 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 19:56:05,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:05,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:05,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:05,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:05,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:05,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:05,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:56:05,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:56:05,133 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 19:56:05,133 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:56:05,133 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:56:05,133 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,133 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:56:05,136 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,136 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:05,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,136 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:05,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:05,136 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:05,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:05,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:05,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:05,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:05,138 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:05,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:05,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:05,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:05,140 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:05,140 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:05,140 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,140 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:05,140 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,140 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:05,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:05,140 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 19:56:05,140 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:56:05,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:05,140 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:05,140 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,140 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,140 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 19:56:05,140 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:56:05,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:05,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:05,141 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:56:05,241 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:56:05,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:56:05,245 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:56:05,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:56:05,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,247 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 19:56:05,247 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:05,247 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 19:56:05,247 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 19:56:05,248 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,248 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,249 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:05,249 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:05,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:05,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:05,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,249 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:05,249 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:56:05,249 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:56:05,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,250 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,250 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 19:56:05,250 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:05,250 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 19:56:05,250 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:05,250 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 19:56:05,250 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:56:05,250 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:56:05,250 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:05,250 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. started... 2023-02-11 19:56:05,250 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 02279d174624d22b1025401891d904b4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:56:05,664 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120564d120618e024aa29bc3d9c433a596c4 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120564d120618e024aa29bc3d9c433a596c4 2023-02-11 19:56:06,069 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp/family1/5e95f43e23214560bea8f0791a397264 2023-02-11 19:56:06,073 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp/family1/5e95f43e23214560bea8f0791a397264 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/5e95f43e23214560bea8f0791a397264 2023-02-11 19:56:06,076 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/5e95f43e23214560bea8f0791a397264, entries=1, sequenceid=17, filesize=4.9 K 2023-02-11 19:56:06,077 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 02279d174624d22b1025401891d904b4 in 827ms, sequenceid=17, compaction requested=true 2023-02-11 19:56:06,078 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 02279d174624d22b1025401891d904b4: 2023-02-11 19:56:06,078 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:06,078 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:56:06,078 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:56:06,078 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:06,078 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 19:56:06,078 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 19:56:06,080 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,080 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:06,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:06,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:06,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:06,080 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,080 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:56:06,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:06,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:06,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:06,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:06,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 19:56:06,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4514824e[Count = 0] remaining members to acquire global barrier 2023-02-11 19:56:06,082 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 19:56:06,082 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,083 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,084 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 19:56:06,084 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 19:56:06,084 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:06,084 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:56:06,084 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:56:06,086 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:06,086 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 19:56:06,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:06,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:06,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:06,086 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:06,086 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 19:56:06,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:06,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:06,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:06,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:06,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:06,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:56:06,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:56:06,088 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 19:56:06,088 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:56:06,088 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:56:06,088 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,088 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:56:06,089 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,089 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,089 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:06,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:06,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:06,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:06,090 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:06,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:06,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:06,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:06,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,091 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:06,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:06,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:06,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:06,093 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:06,093 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,093 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,093 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:06,093 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:06,093 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 19:56:06,093 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:06,093 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 19:56:06,093 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:56:06,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:06,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:06,093 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:06,093 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,093 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,094 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,094 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:56:06,094 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:56:06,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:06,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:06,194 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:56:06,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:56:06,198 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:56:06,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:56:06,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,200 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 19:56:06,200 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:06,200 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 19:56:06,200 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 19:56:06,201 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,201 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,203 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:06,203 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:06,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:06,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:06,204 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:06,204 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:56:06,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,204 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:56:06,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,205 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,205 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 19:56:06,205 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:06,205 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 19:56:06,205 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:06,205 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 19:56:06,205 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:56:06,205 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:56:06,205 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:06,205 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. started... 2023-02-11 19:56:06,205 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 02279d174624d22b1025401891d904b4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:56:06,616 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122854ea6d649eb3436bb02ad4a3917a18a6 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122854ea6d649eb3436bb02ad4a3917a18a6 2023-02-11 19:56:07,021 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp/family1/8b364ef2e26a41c3bc97fe7db7c31381 2023-02-11 19:56:07,025 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp/family1/8b364ef2e26a41c3bc97fe7db7c31381 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/8b364ef2e26a41c3bc97fe7db7c31381 2023-02-11 19:56:07,028 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/8b364ef2e26a41c3bc97fe7db7c31381, entries=1, sequenceid=21, filesize=4.9 K 2023-02-11 19:56:07,029 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 02279d174624d22b1025401891d904b4 in 824ms, sequenceid=21, compaction requested=true 2023-02-11 19:56:07,029 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 02279d174624d22b1025401891d904b4: 2023-02-11 19:56:07,029 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:07,029 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:56:07,029 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:56:07,029 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,029 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 19:56:07,029 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 19:56:07,031 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,031 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:07,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:07,031 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,031 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:56:07,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:07,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:07,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:07,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 19:56:07,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ee26d32[Count = 0] remaining members to acquire global barrier 2023-02-11 19:56:07,032 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 19:56:07,032 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,033 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,034 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 19:56:07,034 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 19:56:07,034 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,034 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:56:07,034 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:56:07,035 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,035 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 19:56:07,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:07,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:07,035 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:07,035 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 19:56:07,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:07,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:07,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:07,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:56:07,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:56:07,037 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 19:56:07,037 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:56:07,037 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:56:07,037 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,037 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:56:07,039 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,039 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:07,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:07,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,039 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:07,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:07,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:07,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:07,040 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:07,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,041 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:07,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,045 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,045 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:07,045 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,045 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 19:56:07,045 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:56:07,045 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,045 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:07,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:07,045 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:07,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:07,045 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,045 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:56:07,045 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,045 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:56:07,045 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:07,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:07,046 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,146 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:56:07,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:56:07,149 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:56:07,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:56:07,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,151 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 19:56:07,151 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:07,151 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 19:56:07,151 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 19:56:07,151 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,151 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,152 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,152 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:07,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:07,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:07,153 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,153 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:56:07,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:56:07,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,153 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,154 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 19:56:07,154 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,154 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 19:56:07,154 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:07,154 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 19:56:07,154 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:56:07,154 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:56:07,154 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:07,154 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. started... 2023-02-11 19:56:07,154 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 02279d174624d22b1025401891d904b4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:56:07,565 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512318bdb89c6f36c46e2b6602e91838324ca to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512318bdb89c6f36c46e2b6602e91838324ca 2023-02-11 19:56:07,970 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp/family1/3717b6d9789d4a14ba34de26e64961fe 2023-02-11 19:56:07,974 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp/family1/3717b6d9789d4a14ba34de26e64961fe as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/3717b6d9789d4a14ba34de26e64961fe 2023-02-11 19:56:07,977 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/3717b6d9789d4a14ba34de26e64961fe, entries=1, sequenceid=25, filesize=4.9 K 2023-02-11 19:56:07,978 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 02279d174624d22b1025401891d904b4 in 824ms, sequenceid=25, compaction requested=true 2023-02-11 19:56:07,978 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 02279d174624d22b1025401891d904b4: 2023-02-11 19:56:07,978 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:07,978 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:56:07,978 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:56:07,978 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,978 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 19:56:07,978 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 19:56:07,979 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,979 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:07,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:07,980 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,980 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:56:07,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:07,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:07,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:07,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 19:56:07,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@553beb73[Count = 0] remaining members to acquire global barrier 2023-02-11 19:56:07,981 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 19:56:07,981 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,982 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,982 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 19:56:07,983 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 19:56:07,982 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,983 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:56:07,983 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:56:07,984 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 19:56:07,984 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:07,984 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,984 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 19:56:07,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:07,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:07,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:07,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:07,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:07,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:56:07,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:56:07,986 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 19:56:07,986 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:56:07,986 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:56:07,986 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,986 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:56:07,988 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,989 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:07,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,989 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:07,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:07,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:07,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:07,989 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:07,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:07,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,990 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:07,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,992 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,992 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:07,992 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:07,992 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:07,992 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 19:56:07,992 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:56:07,992 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,992 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:07,992 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:07,992 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,992 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:07,992 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:56:07,992 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:07,992 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:56:07,992 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 19:56:07,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:07,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:08,093 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:56:08,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:56:08,096 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:56:08,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:56:08,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,098 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 19:56:08,098 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:08,098 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 19:56:08,098 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 19:56:08,098 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,098 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,099 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:08,099 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:08,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:08,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:08,100 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:08,100 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:56:08,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,100 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:56:08,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,101 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,101 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 19:56:08,101 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,101 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 19:56:08,101 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:08,101 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 19:56:08,101 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:56:08,101 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:56:08,101 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:08,101 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. started... 2023-02-11 19:56:08,101 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 02279d174624d22b1025401891d904b4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:56:08,512 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601017d5f6e0f0b19400fb2281fd343596b6c to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601017d5f6e0f0b19400fb2281fd343596b6c 2023-02-11 19:56:08,516 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp/family1/d92ad6060ba14164bf3c0b5361e3a73f 2023-02-11 19:56:08,519 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp/family1/d92ad6060ba14164bf3c0b5361e3a73f as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/d92ad6060ba14164bf3c0b5361e3a73f 2023-02-11 19:56:08,522 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/d92ad6060ba14164bf3c0b5361e3a73f, entries=1, sequenceid=29, filesize=4.9 K 2023-02-11 19:56:08,523 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 02279d174624d22b1025401891d904b4 in 422ms, sequenceid=29, compaction requested=true 2023-02-11 19:56:08,523 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 02279d174624d22b1025401891d904b4: 2023-02-11 19:56:08,523 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:08,524 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:56:08,524 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:56:08,524 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:08,524 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 19:56:08,524 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 19:56:08,525 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:08,525 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:08,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:08,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:08,525 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,525 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:56:08,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:08,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:08,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:08,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:08,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 19:56:08,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3533d648[Count = 0] remaining members to acquire global barrier 2023-02-11 19:56:08,527 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 19:56:08,527 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,529 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,529 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 19:56:08,529 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 19:56:08,529 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:08,529 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:56:08,529 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:56:08,530 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 19:56:08,530 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:08,530 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:08,530 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 19:56:08,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:08,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:08,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:08,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:08,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:08,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:08,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:08,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:08,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:56:08,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:56:08,532 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 19:56:08,532 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:56:08,532 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:56:08,532 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,532 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:56:08,534 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,534 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:08,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,534 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:08,534 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:08,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:08,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:08,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,535 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:08,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:08,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:08,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:08,537 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:08,537 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:08,537 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,537 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:08,537 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,537 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 19:56:08,537 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:08,537 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:56:08,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:08,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:08,537 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:08,538 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:56:08,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:08,537 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:08,538 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:56:08,538 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,538 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,638 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:56:08,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:56:08,642 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:56:08,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:56:08,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,644 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 19:56:08,644 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:08,644 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 19:56:08,644 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 19:56:08,644 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,644 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,646 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:08,646 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:08,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:08,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:08,647 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:08,647 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:56:08,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:56:08,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,647 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,648 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 19:56:08,648 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:08,648 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 19:56:08,648 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:08,648 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 19:56:08,648 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:56:08,648 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:56:08,648 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:08,648 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. started... 2023-02-11 19:56:08,648 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 02279d174624d22b1025401891d904b4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:56:08,657 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032076533542514c9098dd015d44fb5d73 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601032076533542514c9098dd015d44fb5d73 2023-02-11 19:56:08,709 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 19:56:09,062 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp/family1/7e2ed9b9e8a544b2a6fdd4e37eef5af0 2023-02-11 19:56:09,066 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp/family1/7e2ed9b9e8a544b2a6fdd4e37eef5af0 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/7e2ed9b9e8a544b2a6fdd4e37eef5af0 2023-02-11 19:56:09,069 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/7e2ed9b9e8a544b2a6fdd4e37eef5af0, entries=1, sequenceid=33, filesize=4.9 K 2023-02-11 19:56:09,069 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 02279d174624d22b1025401891d904b4 in 421ms, sequenceid=33, compaction requested=true 2023-02-11 19:56:09,069 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 02279d174624d22b1025401891d904b4: 2023-02-11 19:56:09,069 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:09,070 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:56:09,070 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:56:09,070 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:09,070 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 19:56:09,070 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 19:56:09,071 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:09,071 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:09,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:09,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:09,072 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,072 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:56:09,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:09,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:09,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:09,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:09,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 19:56:09,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54d43452[Count = 0] remaining members to acquire global barrier 2023-02-11 19:56:09,073 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 19:56:09,073 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,074 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,074 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 19:56:09,074 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 19:56:09,074 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:56:09,074 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:09,074 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:56:09,075 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 19:56:09,075 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:09,075 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:09,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:09,075 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 19:56:09,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:09,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:09,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:09,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:09,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:09,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:09,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:09,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:56:09,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:56:09,077 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 19:56:09,077 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:56:09,077 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:56:09,077 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,077 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:56:09,080 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,080 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:09,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,080 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:09,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:09,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:09,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:09,080 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:09,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:09,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:09,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,081 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:09,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:09,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:09,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:09,085 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:09,085 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:09,085 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,086 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:09,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:09,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:09,086 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:09,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 19:56:09,086 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 19:56:09,086 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:56:09,086 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:09,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:09,086 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:09,086 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,086 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,086 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,086 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:56:09,086 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:56:09,186 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:56:09,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:56:09,191 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:56:09,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:56:09,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,192 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 19:56:09,192 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:09,192 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 19:56:09,192 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 19:56:09,193 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,193 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,194 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:09,194 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:09,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:09,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:09,194 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:09,194 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:56:09,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:56:09,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,195 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,195 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 19:56:09,195 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:09,195 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 19:56:09,195 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:09,195 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 19:56:09,195 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:56:09,195 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:56:09,195 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:09,195 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. started... 2023-02-11 19:56:09,196 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 02279d174624d22b1025401891d904b4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:56:09,607 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509079eeaf7bfd0a44954afed1516b553d4e1 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201509079eeaf7bfd0a44954afed1516b553d4e1 2023-02-11 19:56:10,012 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp/family1/3646c6c626d94d0f9c569b40f06794ac 2023-02-11 19:56:10,016 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp/family1/3646c6c626d94d0f9c569b40f06794ac as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/3646c6c626d94d0f9c569b40f06794ac 2023-02-11 19:56:10,019 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/3646c6c626d94d0f9c569b40f06794ac, entries=1, sequenceid=37, filesize=4.9 K 2023-02-11 19:56:10,019 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 02279d174624d22b1025401891d904b4 in 823ms, sequenceid=37, compaction requested=true 2023-02-11 19:56:10,020 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 02279d174624d22b1025401891d904b4: 2023-02-11 19:56:10,020 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:10,020 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:56:10,020 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:56:10,020 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,020 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 19:56:10,020 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 19:56:10,021 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,021 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:10,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:10,021 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,021 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:56:10,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:10,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:10,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:10,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 19:56:10,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29224807[Count = 0] remaining members to acquire global barrier 2023-02-11 19:56:10,023 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 19:56:10,023 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,026 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,027 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 19:56:10,027 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 19:56:10,027 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,027 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:56:10,027 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:56:10,028 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 19:56:10,028 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,028 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:10,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:10,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:10,028 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 19:56:10,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:10,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:10,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:10,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:56:10,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:56:10,030 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 19:56:10,030 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:56:10,030 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:56:10,030 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,030 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:56:10,031 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,031 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,031 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:10,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:10,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:10,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:10,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:10,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:10,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,032 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:10,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,033 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:10,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,035 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,035 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:10,035 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,035 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:10,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:10,035 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:10,035 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 19:56:10,035 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:56:10,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:10,035 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,035 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,035 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,035 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,035 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,035 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:56:10,035 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:56:10,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:10,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:10,136 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:56:10,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:56:10,140 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:56:10,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 19:56:10,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,141 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 19:56:10,142 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:10,142 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 19:56:10,142 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 19:56:10,142 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,142 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,145 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:10,145 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:10,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:10,145 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,145 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:56:10,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,145 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:56:10,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,146 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,146 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 19:56:10,146 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,146 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 19:56:10,146 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:10,146 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 19:56:10,146 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:56:10,146 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:56:10,146 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:10,146 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. started... 2023-02-11 19:56:10,146 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 02279d174624d22b1025401891d904b4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 19:56:10,557 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120b12e81ddf2774e3593a6f0d7b88898c5 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120b12e81ddf2774e3593a6f0d7b88898c5 2023-02-11 19:56:10,963 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp/family1/b0c887d9e53a4d7bab40894be0d23205 2023-02-11 19:56:10,966 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp/family1/b0c887d9e53a4d7bab40894be0d23205 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/b0c887d9e53a4d7bab40894be0d23205 2023-02-11 19:56:10,969 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/b0c887d9e53a4d7bab40894be0d23205, entries=1, sequenceid=41, filesize=4.9 K 2023-02-11 19:56:10,970 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 02279d174624d22b1025401891d904b4 in 824ms, sequenceid=41, compaction requested=true 2023-02-11 19:56:10,970 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 02279d174624d22b1025401891d904b4: 2023-02-11 19:56:10,970 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:10,970 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:56:10,970 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:56:10,970 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,970 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 19:56:10,970 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 19:56:10,972 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,972 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:10,972 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,972 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:56:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:10,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:10,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:10,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 19:56:10,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23485e23[Count = 0] remaining members to acquire global barrier 2023-02-11 19:56:10,974 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 19:56:10,974 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,975 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,975 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 19:56:10,975 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 19:56:10,975 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:56:10,975 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,975 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:56:10,976 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 19:56:10,976 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,976 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:10,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:10,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:10,976 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 19:56:10,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:10,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:10,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:10,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:56:10,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 19:56:10,978 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 19:56:10,978 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:56:10,978 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:56:10,978 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,978 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:56:10,983 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,983 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:10,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:10,983 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:10,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:10,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:10,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:10,984 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:10,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,985 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:10,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,987 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:10,987 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:10,987 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:10,987 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:10,987 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 19:56:10,987 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:56:10,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:10,987 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,987 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,987 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:10,987 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,987 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,987 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:10,987 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 19:56:10,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:10,987 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:56:10,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:11,088 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:56:11,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:56:11,090 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40445] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-02-11 19:56:11,091 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 19:56:11,092 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 19:56:11,092 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:56:11,092 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676145971092 2023-02-11 19:56:11,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-11 19:56:11,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-11 19:56:11,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 19:56:11,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] zookeeper.ReadOnlyZKClient(139): Connect 0x1f043de4 to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:56:11,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46fc4b7d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:56:11,098 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 19:56:11,920 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010357009bac697d4a1297f9ed106a7ca411 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010357009bac697d4a1297f9ed106a7ca411 2023-02-11 19:56:11,921 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 19:56:11,933 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:56:11,936 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50024, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:56:11,941 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:56:11,941 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44386, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:56:11,948 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/78a48829fc764da799ab1598e4847ff0 first=Optional[r5] last=Optional[r6] 2023-02-11 19:56:11,949 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/78a48829fc764da799ab1598e4847ff0}] 2023-02-11 19:56:11,954 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/78a48829fc764da799ab1598e4847ff0 for inclusion in 02279d174624d22b1025401891d904b4/family1 2023-02-11 19:56:11,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-11 19:56:11,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 19:56:11,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 02279d174624d22b1025401891d904b4: 2023-02-11 19:56:11,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/78a48829fc764da799ab1598e4847ff0 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithMonthlyPolicy__t5n044l6fkh4rgd57gh76pi2l3qjbl7fsb9339lkhvk0gv6n6dghheomb4m804gp/family1/78a48829fc764da799ab1598e4847ff0 2023-02-11 19:56:11,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithMonthlyPolicy__t5n044l6fkh4rgd57gh76pi2l3qjbl7fsb9339lkhvk0gv6n6dghheomb4m804gp/family1/78a48829fc764da799ab1598e4847ff0 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/94aa1f85fc264b4083f2148589f41b5d_SeqId_44_ 2023-02-11 19:56:11,958 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithMonthlyPolicy__t5n044l6fkh4rgd57gh76pi2l3qjbl7fsb9339lkhvk0gv6n6dghheomb4m804gp/family1/78a48829fc764da799ab1598e4847ff0 into 02279d174624d22b1025401891d904b4/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/94aa1f85fc264b4083f2148589f41b5d_SeqId_44_ - updating store file list. 2023-02-11 19:56:11,961 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/94aa1f85fc264b4083f2148589f41b5d_SeqId_44_ into 02279d174624d22b1025401891d904b4/family1 2023-02-11 19:56:11,961 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithMonthlyPolicy__t5n044l6fkh4rgd57gh76pi2l3qjbl7fsb9339lkhvk0gv6n6dghheomb4m804gp/family1/78a48829fc764da799ab1598e4847ff0 into 02279d174624d22b1025401891d904b4/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/94aa1f85fc264b4083f2148589f41b5d_SeqId_44_) 2023-02-11 19:56:11,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithMonthlyPolicy__t5n044l6fkh4rgd57gh76pi2l3qjbl7fsb9339lkhvk0gv6n6dghheomb4m804gp/family1/78a48829fc764da799ab1598e4847ff0 2023-02-11 19:56:11,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-11 19:56:11,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-11 19:56:11,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(1912): 02279d174624d22b1025401891d904b4/family1 is initiating minor compaction 2023-02-11 19:56:11,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4a3b14c8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:56:11,965 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 02279d174624d22b1025401891d904b4/family1 in testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:11,965 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/2bf11e00918143648f84bf556cac9ff8, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/72e8e988009746e8aca5cc9370232e57, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/5e95f43e23214560bea8f0791a397264, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/8b364ef2e26a41c3bc97fe7db7c31381, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/3717b6d9789d4a14ba34de26e64961fe, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/d92ad6060ba14164bf3c0b5361e3a73f, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/7e2ed9b9e8a544b2a6fdd4e37eef5af0, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/3646c6c626d94d0f9c569b40f06794ac, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/b0c887d9e53a4d7bab40894be0d23205, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/94aa1f85fc264b4083f2148589f41b5d_SeqId_44_] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp, totalSize=49.7 K 2023-02-11 19:56:11,965 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 2bf11e00918143648f84bf556cac9ff8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 19:56:11,965 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 72e8e988009746e8aca5cc9370232e57, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 19:56:11,965 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 5e95f43e23214560bea8f0791a397264, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-11 19:56:11,965 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 8b364ef2e26a41c3bc97fe7db7c31381, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-11 19:56:11,965 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 3717b6d9789d4a14ba34de26e64961fe, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-11 19:56:11,965 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting d92ad6060ba14164bf3c0b5361e3a73f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-11 19:56:11,965 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 7e2ed9b9e8a544b2a6fdd4e37eef5af0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-11 19:56:11,965 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 3646c6c626d94d0f9c569b40f06794ac, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-11 19:56:11,965 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting b0c887d9e53a4d7bab40894be0d23205, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-11 19:56:11,965 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 94aa1f85fc264b4083f2148589f41b5d_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-11 19:56:11,966 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 19:56:11,967 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:56:11,968 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601017d5f6e0f0b19400fb2281fd343596b6c to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601017d5f6e0f0b19400fb2281fd343596b6c 2023-02-11 19:56:11,970 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601032076533542514c9098dd015d44fb5d73 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601032076533542514c9098dd015d44fb5d73 2023-02-11 19:56:11,970 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-11 19:56:11,970 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-11 19:56:11,970 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 19:56:11,970 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 19:56:12,000 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] throttle.PressureAwareThroughputController(145): 02279d174624d22b1025401891d904b4#family1#compaction#166 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-02-11 19:56:12,418 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123155baa9dfb6174ea6a39aedeeef6d8fab to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123155baa9dfb6174ea6a39aedeeef6d8fab 2023-02-11 19:56:12,419 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 19:56:12,443 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/0eae93c7b91145259e818308d43e100e first=Optional[r1] last=Optional[r4] 2023-02-11 19:56:12,443 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/0eae93c7b91145259e818308d43e100e}] 2023-02-11 19:56:12,447 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/0eae93c7b91145259e818308d43e100e for inclusion in 02279d174624d22b1025401891d904b4/family1 2023-02-11 19:56:12,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-11 19:56:12,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 19:56:12,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 02279d174624d22b1025401891d904b4: 2023-02-11 19:56:12,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/0eae93c7b91145259e818308d43e100e to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o21qqn8ekilhg4s8944e49ahqn65ddruilh353i55mvacucbi8fbr25dh0urv4k6/family1/0eae93c7b91145259e818308d43e100e 2023-02-11 19:56:12,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o21qqn8ekilhg4s8944e49ahqn65ddruilh353i55mvacucbi8fbr25dh0urv4k6/family1/0eae93c7b91145259e818308d43e100e as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/b51b1a7bb3b1418e90e8586f9bd5e7f9_SeqId_46_ 2023-02-11 19:56:12,452 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o21qqn8ekilhg4s8944e49ahqn65ddruilh353i55mvacucbi8fbr25dh0urv4k6/family1/0eae93c7b91145259e818308d43e100e into 02279d174624d22b1025401891d904b4/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/b51b1a7bb3b1418e90e8586f9bd5e7f9_SeqId_46_ - updating store file list. 2023-02-11 19:56:12,456 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/b51b1a7bb3b1418e90e8586f9bd5e7f9_SeqId_46_ into 02279d174624d22b1025401891d904b4/family1 2023-02-11 19:56:12,456 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o21qqn8ekilhg4s8944e49ahqn65ddruilh353i55mvacucbi8fbr25dh0urv4k6/family1/0eae93c7b91145259e818308d43e100e into 02279d174624d22b1025401891d904b4/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/b51b1a7bb3b1418e90e8586f9bd5e7f9_SeqId_46_) 2023-02-11 19:56:12,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o21qqn8ekilhg4s8944e49ahqn65ddruilh353i55mvacucbi8fbr25dh0urv4k6/family1/0eae93c7b91145259e818308d43e100e 2023-02-11 19:56:12,459 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 19:56:12,459 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:56:12,461 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201b6f33b84677a46d7a5892f609a9f1dc7 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201b6f33b84677a46d7a5892f609a9f1dc7 2023-02-11 19:56:12,462 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120564d120618e024aa29bc3d9c433a596c4 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120564d120618e024aa29bc3d9c433a596c4 2023-02-11 19:56:12,463 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122854ea6d649eb3436bb02ad4a3917a18a6 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122854ea6d649eb3436bb02ad4a3917a18a6 2023-02-11 19:56:12,464 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512318bdb89c6f36c46e2b6602e91838324ca to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512318bdb89c6f36c46e2b6602e91838324ca 2023-02-11 19:56:12,464 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-11 19:56:12,465 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-11 19:56:12,465 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 19:56:12,465 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 19:56:12,814 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp/family1/0d0ec8019a104323a6c5753e0accffee as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/0d0ec8019a104323a6c5753e0accffee 2023-02-11 19:56:12,818 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 02279d174624d22b1025401891d904b4/family1 of 02279d174624d22b1025401891d904b4 into 0d0ec8019a104323a6c5753e0accffee(size=6.6 K), total size for store is 178.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 19:56:12,818 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 02279d174624d22b1025401891d904b4: 2023-02-11 19:56:12,818 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1676145371964; duration=0sec 2023-02-11 19:56:12,818 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:56:12,835 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/2bf11e00918143648f84bf556cac9ff8, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/72e8e988009746e8aca5cc9370232e57, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/5e95f43e23214560bea8f0791a397264, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/8b364ef2e26a41c3bc97fe7db7c31381, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/3717b6d9789d4a14ba34de26e64961fe, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/d92ad6060ba14164bf3c0b5361e3a73f, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/7e2ed9b9e8a544b2a6fdd4e37eef5af0, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/3646c6c626d94d0f9c569b40f06794ac, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/b0c887d9e53a4d7bab40894be0d23205, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/94aa1f85fc264b4083f2148589f41b5d_SeqId_44_] to archive 2023-02-11 19:56:12,835 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:56:12,837 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/2bf11e00918143648f84bf556cac9ff8 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/2bf11e00918143648f84bf556cac9ff8 2023-02-11 19:56:12,838 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/72e8e988009746e8aca5cc9370232e57 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/72e8e988009746e8aca5cc9370232e57 2023-02-11 19:56:12,839 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/5e95f43e23214560bea8f0791a397264 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/5e95f43e23214560bea8f0791a397264 2023-02-11 19:56:12,840 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/8b364ef2e26a41c3bc97fe7db7c31381 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/8b364ef2e26a41c3bc97fe7db7c31381 2023-02-11 19:56:12,841 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/3717b6d9789d4a14ba34de26e64961fe to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/3717b6d9789d4a14ba34de26e64961fe 2023-02-11 19:56:12,842 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/d92ad6060ba14164bf3c0b5361e3a73f to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/d92ad6060ba14164bf3c0b5361e3a73f 2023-02-11 19:56:12,843 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/7e2ed9b9e8a544b2a6fdd4e37eef5af0 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/7e2ed9b9e8a544b2a6fdd4e37eef5af0 2023-02-11 19:56:12,844 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/3646c6c626d94d0f9c569b40f06794ac to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/3646c6c626d94d0f9c569b40f06794ac 2023-02-11 19:56:12,845 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/b0c887d9e53a4d7bab40894be0d23205 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/b0c887d9e53a4d7bab40894be0d23205 2023-02-11 19:56:12,846 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/94aa1f85fc264b4083f2148589f41b5d_SeqId_44_ to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/94aa1f85fc264b4083f2148589f41b5d_SeqId_44_ 2023-02-11 19:56:13,315 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130eb5a0df0151546899b43a5f47b254675 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130eb5a0df0151546899b43a5f47b254675 2023-02-11 19:56:13,316 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 19:56:13,344 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/941fcc69171e44aaaf31d2e888c45299 first=Optional[r00] last=Optional[r8] 2023-02-11 19:56:13,344 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/941fcc69171e44aaaf31d2e888c45299}] 2023-02-11 19:56:13,346 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/941fcc69171e44aaaf31d2e888c45299 for inclusion in 02279d174624d22b1025401891d904b4/family1 2023-02-11 19:56:13,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-11 19:56:13,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 19:56:13,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 02279d174624d22b1025401891d904b4: 2023-02-11 19:56:13,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/941fcc69171e44aaaf31d2e888c45299 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i6j61cpjn0ecpccos8ohl9cr53dbh5vaafsm8e1ouqq2g3kupdo17o5ad7cnvpkt/family1/941fcc69171e44aaaf31d2e888c45299 2023-02-11 19:56:13,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i6j61cpjn0ecpccos8ohl9cr53dbh5vaafsm8e1ouqq2g3kupdo17o5ad7cnvpkt/family1/941fcc69171e44aaaf31d2e888c45299 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/03d1e52df38a4b80beba51e16e5ddc07_SeqId_49_ 2023-02-11 19:56:13,351 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i6j61cpjn0ecpccos8ohl9cr53dbh5vaafsm8e1ouqq2g3kupdo17o5ad7cnvpkt/family1/941fcc69171e44aaaf31d2e888c45299 into 02279d174624d22b1025401891d904b4/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/03d1e52df38a4b80beba51e16e5ddc07_SeqId_49_ - updating store file list. 2023-02-11 19:56:13,354 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/03d1e52df38a4b80beba51e16e5ddc07_SeqId_49_ into 02279d174624d22b1025401891d904b4/family1 2023-02-11 19:56:13,355 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i6j61cpjn0ecpccos8ohl9cr53dbh5vaafsm8e1ouqq2g3kupdo17o5ad7cnvpkt/family1/941fcc69171e44aaaf31d2e888c45299 into 02279d174624d22b1025401891d904b4/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/03d1e52df38a4b80beba51e16e5ddc07_SeqId_49_) 2023-02-11 19:56:13,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i6j61cpjn0ecpccos8ohl9cr53dbh5vaafsm8e1ouqq2g3kupdo17o5ad7cnvpkt/family1/941fcc69171e44aaaf31d2e888c45299 2023-02-11 19:56:13,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-11 19:56:13,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 352581 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-11 19:56:13,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(1912): 02279d174624d22b1025401891d904b4/family1 is initiating minor compaction (all files) 2023-02-11 19:56:13,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5d3a2ee1; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:56:13,356 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 02279d174624d22b1025401891d904b4/family1 in testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:13,356 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/e99e73dc042c403dbfbae3a69f7462ed, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/0d0ec8019a104323a6c5753e0accffee, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/b51b1a7bb3b1418e90e8586f9bd5e7f9_SeqId_46_, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/03d1e52df38a4b80beba51e16e5ddc07_SeqId_49_] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp, totalSize=344.3 K 2023-02-11 19:56:13,357 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting e99e73dc042c403dbfbae3a69f7462ed, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878840136 2023-02-11 19:56:13,357 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 0d0ec8019a104323a6c5753e0accffee, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621240136 2023-02-11 19:56:13,358 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting b51b1a7bb3b1418e90e8586f9bd5e7f9_SeqId_46_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448965240136 2023-02-11 19:56:13,358 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] compactions.Compactor(207): Compacting 03d1e52df38a4b80beba51e16e5ddc07_SeqId_49_, keycount=1001, bloomtype=ROW, size=166.2 K, encoding=NONE, compression=NONE, seqNum=50, earliestPutTs=1448014840136 2023-02-11 19:56:13,358 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 19:56:13,359 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:56:13,360 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120b12e81ddf2774e3593a6f0d7b88898c5 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120b12e81ddf2774e3593a6f0d7b88898c5 2023-02-11 19:56:13,361 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112802ffe19f8ee44fc3a43064215846f29b to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112802ffe19f8ee44fc3a43064215846f29b 2023-02-11 19:56:13,362 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113009b80299b3d2426984c164c5dd45ce31 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113009b80299b3d2426984c164c5dd45ce31 2023-02-11 19:56:13,362 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-11 19:56:13,362 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-11 19:56:13,363 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 19:56:13,363 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 19:56:13,363 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 19:56:13,363 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 19:56:13,363 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:56:13,365 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 19:56:13,366 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.2750 sec 2023-02-11 19:56:13,375 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] throttle.PressureAwareThroughputController(145): 02279d174624d22b1025401891d904b4#family1#compaction#167 average throughput is 19.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-02-11 19:56:13,485 INFO [Listener at localhost/32929] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=261 (was 248) - Thread LEAK? -, OpenFileDescriptor=648 (was 627) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=219 (was 231), ProcessCount=168 (was 168), AvailableMemoryMB=3654 (was 3530) - AvailableMemoryMB LEAK? - 2023-02-11 19:56:13,500 INFO [Listener at localhost/32929] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=261, OpenFileDescriptor=648, MaxFileDescriptor=60000, SystemLoadAverage=219, ProcessCount=168, AvailableMemoryMB=3654 2023-02-11 19:56:13,519 DEBUG [Listener at localhost/32929] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-02-11 19:56:13,572 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x7F\xFC\xF7#\xC1\xDA\xD9'O\xCFr\xC1\xE1%\xA5M"\x10\xE6\xB3z\x9E\xE7\xB8@\xD3=\x1Ev\xE7\xF0\x03po*\x10KT\xF6/\xAC\xE3\xDF\x16\x95\xC6\xBEo,\xD7\x02\xA62\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-11 19:56:13,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-02-11 19:56:13,574 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:56:13,574 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-02-11 19:56:13,574 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:56:13,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-11 19:56:13,576 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59 2023-02-11 19:56:13,576 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e 2023-02-11 19:56:13,576 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69 2023-02-11 19:56:13,577 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59 empty. 2023-02-11 19:56:13,577 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69 empty. 2023-02-11 19:56:13,577 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e empty. 2023-02-11 19:56:13,577 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59 2023-02-11 19:56:13,577 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69 2023-02-11 19:56:13,577 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e 2023-02-11 19:56:13,577 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-02-11 19:56:13,584 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-02-11 19:56:13,585 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7671): creating {ENCODED => c4cc5915c5085f6b3ca4eeb5d49aac69, NAME => 'testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x7F\xFC\xF7#\xC1\xDA\xD9'O\xCFr\xC1\xE1%\xA5M"\x10\xE6\xB3z\x9E\xE7\xB8@\xD3=\x1Ev\xE7\xF0\x03po*\x10KT\xF6/\xAC\xE3\xDF\x16\x95\xC6\xBEo,\xD7\x02\xA62\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp 2023-02-11 19:56:13,586 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1b36fb7c48b67f7a86dd4a8ca5d25e59, NAME => 'testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x7F\xFC\xF7#\xC1\xDA\xD9'O\xCFr\xC1\xE1%\xA5M"\x10\xE6\xB3z\x9E\xE7\xB8@\xD3=\x1Ev\xE7\xF0\x03po*\x10KT\xF6/\xAC\xE3\xDF\x16\x95\xC6\xBEo,\xD7\x02\xA62\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp 2023-02-11 19:56:13,586 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7fade4c8a6079ee1828f4aac4df78b5e, NAME => 'testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x7F\xFC\xF7#\xC1\xDA\xD9'O\xCFr\xC1\xE1%\xA5M"\x10\xE6\xB3z\x9E\xE7\xB8@\xD3=\x1Ev\xE7\xF0\x03po*\x10KT\xF6/\xAC\xE3\xDF\x16\x95\xC6\xBEo,\xD7\x02\xA62\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/.tmp 2023-02-11 19:56:13,593 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:56:13,594 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1603): Closing 1b36fb7c48b67f7a86dd4a8ca5d25e59, disabling compactions & flushes 2023-02-11 19:56:13,594 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:13,594 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:13,594 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. after waiting 0 ms 2023-02-11 19:56:13,594 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:13,594 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:13,594 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1557): Region close journal for 1b36fb7c48b67f7a86dd4a8ca5d25e59: Waiting for close lock at 1676145373594Disabling compacts and flushes for region at 1676145373594Disabling writes for close at 1676145373594Writing region close event to WAL at 1676145373594Closed at 1676145373594 2023-02-11 19:56:13,595 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:56:13,595 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1603): Closing 7fade4c8a6079ee1828f4aac4df78b5e, disabling compactions & flushes 2023-02-11 19:56:13,595 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:13,595 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:13,595 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. after waiting 0 ms 2023-02-11 19:56:13,595 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:13,595 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:13,595 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1557): Region close journal for 7fade4c8a6079ee1828f4aac4df78b5e: Waiting for close lock at 1676145373595Disabling compacts and flushes for region at 1676145373595Disabling writes for close at 1676145373595Writing region close event to WAL at 1676145373595Closed at 1676145373595 2023-02-11 19:56:13,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-11 19:56:13,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-11 19:56:13,994 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:56:13,995 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1603): Closing c4cc5915c5085f6b3ca4eeb5d49aac69, disabling compactions & flushes 2023-02-11 19:56:13,995 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:13,995 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:13,995 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. after waiting 0 ms 2023-02-11 19:56:13,995 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:13,995 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:13,995 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1557): Region close journal for c4cc5915c5085f6b3ca4eeb5d49aac69: Waiting for close lock at 1676145373995Disabling compacts and flushes for region at 1676145373995Disabling writes for close at 1676145373995Writing region close event to WAL at 1676145373995Closed at 1676145373995 2023-02-11 19:56:13,997 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:56:13,998 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676145373997"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145373997"}]},"ts":"1676145373997"} 2023-02-11 19:56:13,998 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676145373997"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145373997"}]},"ts":"1676145373997"} 2023-02-11 19:56:13,998 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676145373997"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676145373997"}]},"ts":"1676145373997"} 2023-02-11 19:56:14,000 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-11 19:56:14,000 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:56:14,000 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145374000"}]},"ts":"1676145374000"} 2023-02-11 19:56:14,001 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-02-11 19:56:14,005 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1b36fb7c48b67f7a86dd4a8ca5d25e59, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7fade4c8a6079ee1828f4aac4df78b5e, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c4cc5915c5085f6b3ca4eeb5d49aac69, ASSIGN}] 2023-02-11 19:56:14,007 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c4cc5915c5085f6b3ca4eeb5d49aac69, ASSIGN 2023-02-11 19:56:14,007 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7fade4c8a6079ee1828f4aac4df78b5e, ASSIGN 2023-02-11 19:56:14,007 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1b36fb7c48b67f7a86dd4a8ca5d25e59, ASSIGN 2023-02-11 19:56:14,007 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c4cc5915c5085f6b3ca4eeb5d49aac69, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=false 2023-02-11 19:56:14,007 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7fade4c8a6079ee1828f4aac4df78b5e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=false 2023-02-11 19:56:14,008 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1b36fb7c48b67f7a86dd4a8ca5d25e59, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45897,1676145215747; forceNewPlan=false, retain=false 2023-02-11 19:56:14,159 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=1b36fb7c48b67f7a86dd4a8ca5d25e59, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:14,159 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=7fade4c8a6079ee1828f4aac4df78b5e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:14,159 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=c4cc5915c5085f6b3ca4eeb5d49aac69, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:14,159 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676145374159"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145374159"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145374159"}]},"ts":"1676145374159"} 2023-02-11 19:56:14,159 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676145374159"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145374159"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145374159"}]},"ts":"1676145374159"} 2023-02-11 19:56:14,159 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676145374159"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676145374159"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676145374159"}]},"ts":"1676145374159"} 2023-02-11 19:56:14,161 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure 1b36fb7c48b67f7a86dd4a8ca5d25e59, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:56:14,161 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=118, state=RUNNABLE; OpenRegionProcedure 7fade4c8a6079ee1828f4aac4df78b5e, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:56:14,162 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=119, state=RUNNABLE; OpenRegionProcedure c4cc5915c5085f6b3ca4eeb5d49aac69, server=jenkins-hbase4.apache.org,45897,1676145215747}] 2023-02-11 19:56:14,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-11 19:56:14,315 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:14,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1b36fb7c48b67f7a86dd4a8ca5d25e59, NAME => 'testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59.', STARTKEY => '', ENDKEY => '1'} 2023-02-11 19:56:14,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 1b36fb7c48b67f7a86dd4a8ca5d25e59 2023-02-11 19:56:14,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:56:14,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1b36fb7c48b67f7a86dd4a8ca5d25e59 2023-02-11 19:56:14,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1b36fb7c48b67f7a86dd4a8ca5d25e59 2023-02-11 19:56:14,336 INFO [StoreOpener-1b36fb7c48b67f7a86dd4a8ca5d25e59-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1b36fb7c48b67f7a86dd4a8ca5d25e59 2023-02-11 19:56:14,338 DEBUG [StoreOpener-1b36fb7c48b67f7a86dd4a8ca5d25e59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1 2023-02-11 19:56:14,338 DEBUG [StoreOpener-1b36fb7c48b67f7a86dd4a8ca5d25e59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1 2023-02-11 19:56:14,338 INFO [StoreOpener-1b36fb7c48b67f7a86dd4a8ca5d25e59-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b36fb7c48b67f7a86dd4a8ca5d25e59 columnFamilyName family1 2023-02-11 19:56:14,339 INFO [StoreOpener-1b36fb7c48b67f7a86dd4a8ca5d25e59-1] regionserver.HStore(310): Store=1b36fb7c48b67f7a86dd4a8ca5d25e59/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:56:14,339 INFO [StoreOpener-1b36fb7c48b67f7a86dd4a8ca5d25e59-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1b36fb7c48b67f7a86dd4a8ca5d25e59 2023-02-11 19:56:14,340 DEBUG [StoreOpener-1b36fb7c48b67f7a86dd4a8ca5d25e59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2 2023-02-11 19:56:14,341 DEBUG [StoreOpener-1b36fb7c48b67f7a86dd4a8ca5d25e59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2 2023-02-11 19:56:14,341 INFO [StoreOpener-1b36fb7c48b67f7a86dd4a8ca5d25e59-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b36fb7c48b67f7a86dd4a8ca5d25e59 columnFamilyName family2 2023-02-11 19:56:14,342 INFO [StoreOpener-1b36fb7c48b67f7a86dd4a8ca5d25e59-1] regionserver.HStore(310): Store=1b36fb7c48b67f7a86dd4a8ca5d25e59/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:56:14,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59 2023-02-11 19:56:14,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59 2023-02-11 19:56:14,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:56:14,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1b36fb7c48b67f7a86dd4a8ca5d25e59 2023-02-11 19:56:14,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:56:14,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1b36fb7c48b67f7a86dd4a8ca5d25e59; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64378150, jitterRate=-0.04069080948829651}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:56:14,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1b36fb7c48b67f7a86dd4a8ca5d25e59: Running coprocessor pre-open hook at 1676145374315Writing region info on filesystem at 1676145374316 (+1 ms)Initializing all the Stores at 1676145374316Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x7F\xFC\xF7#\xC1\xDA\xD9'O\xCFr\xC1\xE1%\xA5M"\x10\xE6\xB3z\x9E\xE7\xB8@\xD3=\x1Ev\xE7\xF0\x03po*\x10KT\xF6/\xAC\xE3\xDF\x16\x95\xC6\xBEo,\xD7\x02\xA62\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145374316Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145374316Cleaning up temporary data from old regions at 1676145374343 (+27 ms)Cleaning up detritus from prior splits at 1676145374343Running coprocessor post-open hooks at 1676145374346 (+3 ms)Region opened successfully at 1676145374346 2023-02-11 19:56:14,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59., pid=120, masterSystemTime=1676145374312 2023-02-11 19:56:14,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:14,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:14,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:14,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7fade4c8a6079ee1828f4aac4df78b5e, NAME => 'testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e.', STARTKEY => '1', ENDKEY => '2'} 2023-02-11 19:56:14,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 7fade4c8a6079ee1828f4aac4df78b5e 2023-02-11 19:56:14,349 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=1b36fb7c48b67f7a86dd4a8ca5d25e59, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:14,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:56:14,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7fade4c8a6079ee1828f4aac4df78b5e 2023-02-11 19:56:14,349 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676145374349"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145374349"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145374349"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145374349"}]},"ts":"1676145374349"} 2023-02-11 19:56:14,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7fade4c8a6079ee1828f4aac4df78b5e 2023-02-11 19:56:14,352 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=117 2023-02-11 19:56:14,352 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure 1b36fb7c48b67f7a86dd4a8ca5d25e59, server=jenkins-hbase4.apache.org,45897,1676145215747 in 189 msec 2023-02-11 19:56:14,353 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1b36fb7c48b67f7a86dd4a8ca5d25e59, ASSIGN in 347 msec 2023-02-11 19:56:14,386 INFO [StoreOpener-7fade4c8a6079ee1828f4aac4df78b5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7fade4c8a6079ee1828f4aac4df78b5e 2023-02-11 19:56:14,388 DEBUG [StoreOpener-7fade4c8a6079ee1828f4aac4df78b5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1 2023-02-11 19:56:14,388 DEBUG [StoreOpener-7fade4c8a6079ee1828f4aac4df78b5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1 2023-02-11 19:56:14,389 INFO [StoreOpener-7fade4c8a6079ee1828f4aac4df78b5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7fade4c8a6079ee1828f4aac4df78b5e columnFamilyName family1 2023-02-11 19:56:14,389 INFO [StoreOpener-7fade4c8a6079ee1828f4aac4df78b5e-1] regionserver.HStore(310): Store=7fade4c8a6079ee1828f4aac4df78b5e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:56:14,390 INFO [StoreOpener-7fade4c8a6079ee1828f4aac4df78b5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7fade4c8a6079ee1828f4aac4df78b5e 2023-02-11 19:56:14,391 DEBUG [StoreOpener-7fade4c8a6079ee1828f4aac4df78b5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2 2023-02-11 19:56:14,391 DEBUG [StoreOpener-7fade4c8a6079ee1828f4aac4df78b5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2 2023-02-11 19:56:14,391 INFO [StoreOpener-7fade4c8a6079ee1828f4aac4df78b5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7fade4c8a6079ee1828f4aac4df78b5e columnFamilyName family2 2023-02-11 19:56:14,392 INFO [StoreOpener-7fade4c8a6079ee1828f4aac4df78b5e-1] regionserver.HStore(310): Store=7fade4c8a6079ee1828f4aac4df78b5e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:56:14,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e 2023-02-11 19:56:14,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e 2023-02-11 19:56:14,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:56:14,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7fade4c8a6079ee1828f4aac4df78b5e 2023-02-11 19:56:14,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:56:14,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7fade4c8a6079ee1828f4aac4df78b5e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75020627, jitterRate=0.11789445579051971}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:56:14,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7fade4c8a6079ee1828f4aac4df78b5e: Running coprocessor pre-open hook at 1676145374349Writing region info on filesystem at 1676145374349Initializing all the Stores at 1676145374351 (+2 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x7F\xFC\xF7#\xC1\xDA\xD9'O\xCFr\xC1\xE1%\xA5M"\x10\xE6\xB3z\x9E\xE7\xB8@\xD3=\x1Ev\xE7\xF0\x03po*\x10KT\xF6/\xAC\xE3\xDF\x16\x95\xC6\xBEo,\xD7\x02\xA62\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145374351Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145374356 (+5 ms)Cleaning up temporary data from old regions at 1676145374393 (+37 ms)Cleaning up detritus from prior splits at 1676145374394 (+1 ms)Running coprocessor post-open hooks at 1676145374396 (+2 ms)Region opened successfully at 1676145374397 (+1 ms) 2023-02-11 19:56:14,397 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e., pid=121, masterSystemTime=1676145374312 2023-02-11 19:56:14,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:14,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:14,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:14,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c4cc5915c5085f6b3ca4eeb5d49aac69, NAME => 'testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69.', STARTKEY => '2', ENDKEY => ''} 2023-02-11 19:56:14,399 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=7fade4c8a6079ee1828f4aac4df78b5e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:14,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin c4cc5915c5085f6b3ca4eeb5d49aac69 2023-02-11 19:56:14,399 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676145374399"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145374399"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145374399"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145374399"}]},"ts":"1676145374399"} 2023-02-11 19:56:14,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:56:14,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c4cc5915c5085f6b3ca4eeb5d49aac69 2023-02-11 19:56:14,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c4cc5915c5085f6b3ca4eeb5d49aac69 2023-02-11 19:56:14,401 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=118 2023-02-11 19:56:14,401 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=118, state=SUCCESS; OpenRegionProcedure 7fade4c8a6079ee1828f4aac4df78b5e, server=jenkins-hbase4.apache.org,45897,1676145215747 in 239 msec 2023-02-11 19:56:14,402 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7fade4c8a6079ee1828f4aac4df78b5e, ASSIGN in 396 msec 2023-02-11 19:56:14,419 INFO [StoreOpener-c4cc5915c5085f6b3ca4eeb5d49aac69-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c4cc5915c5085f6b3ca4eeb5d49aac69 2023-02-11 19:56:14,420 DEBUG [StoreOpener-c4cc5915c5085f6b3ca4eeb5d49aac69-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1 2023-02-11 19:56:14,421 DEBUG [StoreOpener-c4cc5915c5085f6b3ca4eeb5d49aac69-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1 2023-02-11 19:56:14,421 INFO [StoreOpener-c4cc5915c5085f6b3ca4eeb5d49aac69-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c4cc5915c5085f6b3ca4eeb5d49aac69 columnFamilyName family1 2023-02-11 19:56:14,421 INFO [StoreOpener-c4cc5915c5085f6b3ca4eeb5d49aac69-1] regionserver.HStore(310): Store=c4cc5915c5085f6b3ca4eeb5d49aac69/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:56:14,422 INFO [StoreOpener-c4cc5915c5085f6b3ca4eeb5d49aac69-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c4cc5915c5085f6b3ca4eeb5d49aac69 2023-02-11 19:56:14,423 DEBUG [StoreOpener-c4cc5915c5085f6b3ca4eeb5d49aac69-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2 2023-02-11 19:56:14,423 DEBUG [StoreOpener-c4cc5915c5085f6b3ca4eeb5d49aac69-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2 2023-02-11 19:56:14,423 INFO [StoreOpener-c4cc5915c5085f6b3ca4eeb5d49aac69-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c4cc5915c5085f6b3ca4eeb5d49aac69 columnFamilyName family2 2023-02-11 19:56:14,424 INFO [StoreOpener-c4cc5915c5085f6b3ca4eeb5d49aac69-1] regionserver.HStore(310): Store=c4cc5915c5085f6b3ca4eeb5d49aac69/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:56:14,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69 2023-02-11 19:56:14,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69 2023-02-11 19:56:14,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:56:14,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c4cc5915c5085f6b3ca4eeb5d49aac69 2023-02-11 19:56:14,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:56:14,428 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c4cc5915c5085f6b3ca4eeb5d49aac69; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61454031, jitterRate=-0.08426357805728912}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:56:14,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c4cc5915c5085f6b3ca4eeb5d49aac69: Running coprocessor pre-open hook at 1676145374399Writing region info on filesystem at 1676145374399Initializing all the Stores at 1676145374399Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x7F\xFC\xF7#\xC1\xDA\xD9'O\xCFr\xC1\xE1%\xA5M"\x10\xE6\xB3z\x9E\xE7\xB8@\xD3=\x1Ev\xE7\xF0\x03po*\x10KT\xF6/\xAC\xE3\xDF\x16\x95\xC6\xBEo,\xD7\x02\xA62\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145374400 (+1 ms)Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676145374400Cleaning up temporary data from old regions at 1676145374425 (+25 ms)Cleaning up detritus from prior splits at 1676145374425Running coprocessor post-open hooks at 1676145374428 (+3 ms)Region opened successfully at 1676145374428 2023-02-11 19:56:14,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69., pid=122, masterSystemTime=1676145374312 2023-02-11 19:56:14,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:14,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:14,431 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=c4cc5915c5085f6b3ca4eeb5d49aac69, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:14,431 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676145374430"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676145374430"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676145374430"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676145374430"}]},"ts":"1676145374430"} 2023-02-11 19:56:14,433 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=119 2023-02-11 19:56:14,433 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=119, state=SUCCESS; OpenRegionProcedure c4cc5915c5085f6b3ca4eeb5d49aac69, server=jenkins-hbase4.apache.org,45897,1676145215747 in 270 msec 2023-02-11 19:56:14,434 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=119, resume processing ppid=116 2023-02-11 19:56:14,434 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c4cc5915c5085f6b3ca4eeb5d49aac69, ASSIGN in 428 msec 2023-02-11 19:56:14,434 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:56:14,435 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676145374435"}]},"ts":"1676145374435"} 2023-02-11 19:56:14,435 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-02-11 19:56:14,437 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:56:14,438 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 865 msec 2023-02-11 19:56:14,594 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/.tmp/family1/5cf852cb737644c9ade7404e2980ce9d as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/5cf852cb737644c9ade7404e2980ce9d 2023-02-11 19:56:14,599 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 02279d174624d22b1025401891d904b4/family1 of 02279d174624d22b1025401891d904b4 into 5cf852cb737644c9ade7404e2980ce9d(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 19:56:14,599 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 02279d174624d22b1025401891d904b4: 2023-02-11 19:56:14,599 INFO [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4., storeName=family1, fileCount=4, fileSize=344.3 K (166.0 K, 6.6 K, 5.5 K, 166.2 K), priority=2, time=1676145373356; duration=1sec 2023-02-11 19:56:14,599 DEBUG [RS:0;jenkins-hbase4:45897-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 19:56:14,634 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/e99e73dc042c403dbfbae3a69f7462ed, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/0d0ec8019a104323a6c5753e0accffee, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/b51b1a7bb3b1418e90e8586f9bd5e7f9_SeqId_46_, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/03d1e52df38a4b80beba51e16e5ddc07_SeqId_49_] to archive 2023-02-11 19:56:14,635 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:56:14,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/e99e73dc042c403dbfbae3a69f7462ed to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/e99e73dc042c403dbfbae3a69f7462ed 2023-02-11 19:56:14,638 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/0d0ec8019a104323a6c5753e0accffee to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/0d0ec8019a104323a6c5753e0accffee 2023-02-11 19:56:14,640 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/b51b1a7bb3b1418e90e8586f9bd5e7f9_SeqId_46_ to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/b51b1a7bb3b1418e90e8586f9bd5e7f9_SeqId_46_ 2023-02-11 19:56:14,641 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/03d1e52df38a4b80beba51e16e5ddc07_SeqId_49_ to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/family1/03d1e52df38a4b80beba51e16e5ddc07_SeqId_49_ 2023-02-11 19:56:14,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-11 19:56:14,679 INFO [Listener at localhost/32929] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-02-11 19:56:14,684 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:56:14,685 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:56:14,685 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:56:14,687 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:56:14,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-11 19:56:14,689 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-11 19:56:14,689 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:14,689 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-11 19:56:14,689 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-11 19:56:14,689 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:14,689 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:14,690 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:14,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:14,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:14,691 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:14,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:14,691 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:14,691 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:56:14,691 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:14,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:56:14,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:14,692 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-11 19:56:14,692 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-11 19:56:14,692 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-11 19:56:14,692 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:14,692 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-11 19:56:14,696 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:14,696 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. started... 2023-02-11 19:56:14,696 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:14,696 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. started... 2023-02-11 19:56:14,697 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 19:56:14,697 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c4cc5915c5085f6b3ca4eeb5d49aac69 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 19:56:14,697 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:56:14,697 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:14,698 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. started... 2023-02-11 19:56:14,697 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7fade4c8a6079ee1828f4aac4df78b5e 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 19:56:14,698 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1b36fb7c48b67f7a86dd4a8ca5d25e59 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 19:56:14,754 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211f7de6bba142c4180b1f41054440014a4 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211f7de6bba142c4180b1f41054440014a4 2023-02-11 19:56:14,765 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211ca3d84c52d9e4c8aa6e5a637ca67c4fe to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211ca3d84c52d9e4c8aa6e5a637ca67c4fe 2023-02-11 19:56:14,770 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp/family1/aae869c8fecc4a668d6893f8559f92b0 2023-02-11 19:56:14,788 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp/family1/ea3838aa61794c00bc5fbb6e9901bc50 2023-02-11 19:56:14,803 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302118db332f1a7544629beee23659d5b48ce to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202302118db332f1a7544629beee23659d5b48ce 2023-02-11 19:56:14,813 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp/family2/78498d4f9d604d1c8f8aa08dfc689bd2 2023-02-11 19:56:14,820 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp/family1/aae869c8fecc4a668d6893f8559f92b0 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/aae869c8fecc4a668d6893f8559f92b0 2023-02-11 19:56:14,838 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211cfa636504f444eb78241a4d3262048c3 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230211cfa636504f444eb78241a4d3262048c3 2023-02-11 19:56:14,848 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/aae869c8fecc4a668d6893f8559f92b0, entries=4, sequenceid=5, filesize=5.5 K 2023-02-11 19:56:14,848 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp/family2/574d7a31ca6d47ba8e7b671a87bbce6c 2023-02-11 19:56:14,849 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp/family2/78498d4f9d604d1c8f8aa08dfc689bd2 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/78498d4f9d604d1c8f8aa08dfc689bd2 2023-02-11 19:56:14,853 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp/family1/ea3838aa61794c00bc5fbb6e9901bc50 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/ea3838aa61794c00bc5fbb6e9901bc50 2023-02-11 19:56:14,853 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/78498d4f9d604d1c8f8aa08dfc689bd2, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 19:56:14,853 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c4cc5915c5085f6b3ca4eeb5d49aac69 in 156ms, sequenceid=5, compaction requested=false 2023-02-11 19:56:14,854 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-02-11 19:56:14,854 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c4cc5915c5085f6b3ca4eeb5d49aac69: 2023-02-11 19:56:14,854 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:14,854 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 19:56:14,887 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/ea3838aa61794c00bc5fbb6e9901bc50, entries=4, sequenceid=5, filesize=5.5 K 2023-02-11 19:56:14,888 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp/family2/574d7a31ca6d47ba8e7b671a87bbce6c as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/574d7a31ca6d47ba8e7b671a87bbce6c 2023-02-11 19:56:14,892 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/574d7a31ca6d47ba8e7b671a87bbce6c, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 19:56:14,893 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 7fade4c8a6079ee1828f4aac4df78b5e in 196ms, sequenceid=5, compaction requested=false 2023-02-11 19:56:14,894 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7fade4c8a6079ee1828f4aac4df78b5e: 2023-02-11 19:56:14,894 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:14,894 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 19:56:15,147 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302112fe944cbd58744e69c6ba88d684f9de2 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302112fe944cbd58744e69c6ba88d684f9de2 2023-02-11 19:56:15,562 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp/family1/7431b4cb65ad4642a2b24cc2fa22d42d 2023-02-11 19:56:15,996 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211100ba592934046139f8dffd2643f3d74 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230211100ba592934046139f8dffd2643f3d74 2023-02-11 19:56:16,400 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp/family2/19e77d104d38441fbbd84507ef429d68 2023-02-11 19:56:16,404 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp/family1/7431b4cb65ad4642a2b24cc2fa22d42d as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/7431b4cb65ad4642a2b24cc2fa22d42d 2023-02-11 19:56:16,428 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/7431b4cb65ad4642a2b24cc2fa22d42d, entries=4, sequenceid=5, filesize=5.5 K 2023-02-11 19:56:16,429 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp/family2/19e77d104d38441fbbd84507ef429d68 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/19e77d104d38441fbbd84507ef429d68 2023-02-11 19:56:16,432 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/19e77d104d38441fbbd84507ef429d68, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 19:56:16,433 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 1b36fb7c48b67f7a86dd4a8ca5d25e59 in 1735ms, sequenceid=5, compaction requested=false 2023-02-11 19:56:16,433 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1b36fb7c48b67f7a86dd4a8ca5d25e59: 2023-02-11 19:56:16,433 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:16,433 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 19:56:16,433 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 19:56:16,433 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:16,433 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-11 19:56:16,433 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-11 19:56:16,438 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:16,438 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:16,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:16,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:16,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:16,438 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:16,438 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:56:16,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:16,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:16,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:16,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:16,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:16,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-11 19:56:16,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8e24d94[Count = 0] remaining members to acquire global barrier 2023-02-11 19:56:16,440 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-11 19:56:16,440 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:16,441 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:16,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:16,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:16,441 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-11 19:56:16,441 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-11 19:56:16,441 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:56:16,441 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:16,441 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:56:16,442 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:16,442 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-11 19:56:16,442 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:16,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:16,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:16,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:16,442 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-11 19:56:16,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:16,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:16,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:16,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:16,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:16,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:16,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:16,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:56:16,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-11 19:56:16,444 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-11 19:56:16,444 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:56:16,444 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:56:16,444 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-11 19:56:16,444 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:56:16,446 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:16,446 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:16,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:16,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:16,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:16,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:16,446 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:16,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:16,446 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:16,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:16,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:16,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:16,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:16,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:16,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:16,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:16,447 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:16,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:16,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:16,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:16,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:16,451 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:16,451 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:16,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:16,451 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-11 19:56:16,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:16,451 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-11 19:56:16,451 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:56:16,451 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:16,451 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:16,451 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:16,451 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:16,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:16,451 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:16,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:16,451 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-11 19:56:16,451 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:16,451 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:56:16,451 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:16,451 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:16,551 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:56:16,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:56:16,553 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:56:16,554 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:56:16,554 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:56:16,556 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:56:16,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-11 19:56:16,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-11 19:56:16,558 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-11 19:56:16,558 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:16,558 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-11 19:56:16,558 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-11 19:56:16,558 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:16,558 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:16,559 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:16,559 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:16,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:16,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:16,560 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:16,560 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:56:16,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:16,560 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:16,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:56:16,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:16,560 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-11 19:56:16,564 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-11 19:56:16,565 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-11 19:56:16,565 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-11 19:56:16,565 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:16,565 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-11 19:56:16,565 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:16,565 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:16,565 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. started... 2023-02-11 19:56:16,565 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:16,565 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 19:56:16,565 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7fade4c8a6079ee1828f4aac4df78b5e 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 19:56:16,565 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:56:16,565 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. started... 2023-02-11 19:56:16,565 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. started... 2023-02-11 19:56:16,565 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1b36fb7c48b67f7a86dd4a8ca5d25e59 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 19:56:16,565 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c4cc5915c5085f6b3ca4eeb5d49aac69 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 19:56:17,015 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302115529de656beb4ec3b59f6b587be3d29f to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302115529de656beb4ec3b59f6b587be3d29f 2023-02-11 19:56:17,015 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211fa1d3abcd2f242c1be47172bdaadeaca to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211fa1d3abcd2f242c1be47172bdaadeaca 2023-02-11 19:56:17,025 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302114e23927014954a7796f5dd0e7fb668a2 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302114e23927014954a7796f5dd0e7fb668a2 2023-02-11 19:56:17,040 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp/family1/10074e58727c4dd88025b6905b7c45da 2023-02-11 19:56:17,430 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp/family1/89641649cd254bbe843b50723f5e3431 2023-02-11 19:56:17,433 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp/family1/db6306c86ee6444ca21ab07b62b2d91d 2023-02-11 19:56:17,463 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211405cb49cd8634c32a67a0e175c0a919a to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230211405cb49cd8634c32a67a0e175c0a919a 2023-02-11 19:56:17,468 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp/family2/77c347949b224d4cbee381f124f819e7 2023-02-11 19:56:17,471 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211a5b2ada922bc45f7a753cd52ee197fc9 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230211a5b2ada922bc45f7a753cd52ee197fc9 2023-02-11 19:56:17,472 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp/family1/db6306c86ee6444ca21ab07b62b2d91d as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/db6306c86ee6444ca21ab07b62b2d91d 2023-02-11 19:56:17,495 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/db6306c86ee6444ca21ab07b62b2d91d, entries=4, sequenceid=9, filesize=5.5 K 2023-02-11 19:56:17,495 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp/family2/77c347949b224d4cbee381f124f819e7 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/77c347949b224d4cbee381f124f819e7 2023-02-11 19:56:17,498 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/77c347949b224d4cbee381f124f819e7, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 19:56:17,499 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 7fade4c8a6079ee1828f4aac4df78b5e in 934ms, sequenceid=9, compaction requested=false 2023-02-11 19:56:17,499 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7fade4c8a6079ee1828f4aac4df78b5e: 2023-02-11 19:56:17,499 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:17,499 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 19:56:17,874 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211b4a851191c454d2689d35c01c230657f to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230211b4a851191c454d2689d35c01c230657f 2023-02-11 19:56:17,875 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp/family2/06c648413a6d4f349c5f888513d11c1f 2023-02-11 19:56:17,879 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp/family1/10074e58727c4dd88025b6905b7c45da as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/10074e58727c4dd88025b6905b7c45da 2023-02-11 19:56:17,902 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/10074e58727c4dd88025b6905b7c45da, entries=4, sequenceid=9, filesize=5.5 K 2023-02-11 19:56:17,903 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp/family2/06c648413a6d4f349c5f888513d11c1f as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/06c648413a6d4f349c5f888513d11c1f 2023-02-11 19:56:17,906 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/06c648413a6d4f349c5f888513d11c1f, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 19:56:17,907 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 1b36fb7c48b67f7a86dd4a8ca5d25e59 in 1342ms, sequenceid=9, compaction requested=false 2023-02-11 19:56:17,907 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1b36fb7c48b67f7a86dd4a8ca5d25e59: 2023-02-11 19:56:17,907 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:17,907 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 19:56:18,279 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp/family2/328b360a45ce4f14b84253dec34c5327 2023-02-11 19:56:18,283 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp/family1/89641649cd254bbe843b50723f5e3431 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/89641649cd254bbe843b50723f5e3431 2023-02-11 19:56:18,308 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/89641649cd254bbe843b50723f5e3431, entries=4, sequenceid=9, filesize=5.5 K 2023-02-11 19:56:18,309 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp/family2/328b360a45ce4f14b84253dec34c5327 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/328b360a45ce4f14b84253dec34c5327 2023-02-11 19:56:18,312 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/328b360a45ce4f14b84253dec34c5327, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 19:56:18,313 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c4cc5915c5085f6b3ca4eeb5d49aac69 in 1748ms, sequenceid=9, compaction requested=false 2023-02-11 19:56:18,313 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c4cc5915c5085f6b3ca4eeb5d49aac69: 2023-02-11 19:56:18,313 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:18,313 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 19:56:18,313 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 19:56:18,313 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:18,313 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-11 19:56:18,313 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-11 19:56:18,315 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:18,315 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:18,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:18,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:18,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:18,315 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:18,315 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:56:18,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:18,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:18,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:18,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:18,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:18,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-11 19:56:18,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d619e7e[Count = 0] remaining members to acquire global barrier 2023-02-11 19:56:18,316 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-11 19:56:18,317 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:18,318 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:18,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:18,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:18,319 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-11 19:56:18,319 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-11 19:56:18,319 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:56:18,319 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:18,319 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:56:18,320 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-11 19:56:18,320 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:18,320 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:18,320 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-11 19:56:18,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:18,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:18,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:18,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:18,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:18,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:18,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:18,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:18,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:18,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:18,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:56:18,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-11 19:56:18,322 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-11 19:56:18,322 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:56:18,322 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:56:18,322 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-11 19:56:18,322 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:56:18,324 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:18,324 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:18,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:18,324 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:18,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:18,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:18,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:18,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:18,324 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:18,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:18,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:18,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:18,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:18,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:18,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:18,326 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:18,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:18,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:18,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:18,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:18,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:18,328 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:18,328 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:18,328 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:18,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:18,328 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:18,328 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:18,328 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-11 19:56:18,328 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:56:18,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:18,328 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:18,328 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:18,328 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:18,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-11 19:56:18,328 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-11 19:56:18,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:18,328 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:18,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:18,328 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:56:18,328 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:18,429 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:56:18,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:56:18,431 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:56:18,431 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:56:18,431 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:56:18,433 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:56:18,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-11 19:56:18,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-11 19:56:18,435 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-11 19:56:18,435 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:18,435 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-11 19:56:18,435 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-11 19:56:18,435 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:18,435 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:18,437 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:18,437 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:18,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:18,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:18,437 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:18,437 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:56:18,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:18,438 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:18,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:56:18,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:18,438 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-11 19:56:18,438 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-11 19:56:18,438 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-11 19:56:18,438 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-11 19:56:18,438 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:18,438 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-11 19:56:18,439 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:18,439 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. started... 2023-02-11 19:56:18,439 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 19:56:18,439 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:18,439 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7fade4c8a6079ee1828f4aac4df78b5e 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 19:56:18,439 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. started... 2023-02-11 19:56:18,439 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:18,439 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:56:18,439 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. started... 2023-02-11 19:56:18,439 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c4cc5915c5085f6b3ca4eeb5d49aac69 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 19:56:18,439 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1b36fb7c48b67f7a86dd4a8ca5d25e59 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 19:56:18,925 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:56:18,925 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f043de4 to 127.0.0.1:64025 2023-02-11 19:56:18,926 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:56:18,926 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:56:18,926 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1774f383 to 127.0.0.1:64025 2023-02-11 19:56:18,926 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:56:18,928 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302116681ebe3efff42619aa0a3d36957537b to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302116681ebe3efff42619aa0a3d36957537b 2023-02-11 19:56:18,935 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211363eab67dc7841519edfe08310180d36 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211363eab67dc7841519edfe08310180d36 2023-02-11 19:56:18,935 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211081200d0d1b44efcb7d6ff2c170f13e8 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211081200d0d1b44efcb7d6ff2c170f13e8 2023-02-11 19:56:18,949 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp/family1/dcfbb9e5b536417191f843bd3e809404 2023-02-11 19:56:18,952 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp/family1/b56cc55c79664bdb8e2854f7fe2f7e45 2023-02-11 19:56:19,353 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp/family1/c99ea090d14c45d5a2f846db3cb223eb 2023-02-11 19:56:19,392 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302110395f205d66d4af68dfd2d81d4916747 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202302110395f205d66d4af68dfd2d81d4916747 2023-02-11 19:56:19,400 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302114d8fc514adc54642b7011ccf380214b5 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302114d8fc514adc54642b7011ccf380214b5 2023-02-11 19:56:19,786 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211b901bcb7dca444ca8d3c51aa04e51e3f to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230211b901bcb7dca444ca8d3c51aa04e51e3f 2023-02-11 19:56:19,797 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp/family2/fadf07f974434b6a837db1cd5f91a893 2023-02-11 19:56:19,800 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp/family1/dcfbb9e5b536417191f843bd3e809404 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/dcfbb9e5b536417191f843bd3e809404 2023-02-11 19:56:19,804 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp/family2/a35a45513b5e4073b493090768db8fd2 2023-02-11 19:56:19,807 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp/family1/b56cc55c79664bdb8e2854f7fe2f7e45 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/b56cc55c79664bdb8e2854f7fe2f7e45 2023-02-11 19:56:19,823 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/dcfbb9e5b536417191f843bd3e809404, entries=4, sequenceid=13, filesize=5.5 K 2023-02-11 19:56:19,824 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp/family2/fadf07f974434b6a837db1cd5f91a893 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/fadf07f974434b6a837db1cd5f91a893 2023-02-11 19:56:19,826 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/fadf07f974434b6a837db1cd5f91a893, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 19:56:19,827 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 1b36fb7c48b67f7a86dd4a8ca5d25e59 in 1388ms, sequenceid=13, compaction requested=true 2023-02-11 19:56:19,827 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1b36fb7c48b67f7a86dd4a8ca5d25e59: 2023-02-11 19:56:19,827 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:19,827 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 19:56:19,828 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/b56cc55c79664bdb8e2854f7fe2f7e45, entries=4, sequenceid=13, filesize=5.5 K 2023-02-11 19:56:19,829 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp/family2/a35a45513b5e4073b493090768db8fd2 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/a35a45513b5e4073b493090768db8fd2 2023-02-11 19:56:19,831 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/a35a45513b5e4073b493090768db8fd2, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 19:56:19,832 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 7fade4c8a6079ee1828f4aac4df78b5e in 1393ms, sequenceid=13, compaction requested=true 2023-02-11 19:56:19,832 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7fade4c8a6079ee1828f4aac4df78b5e: 2023-02-11 19:56:19,832 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:19,832 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 19:56:19,853 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 19:56:20,191 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp/family2/8c58c360741d43eda46d9a15a261a907 2023-02-11 19:56:20,195 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp/family1/c99ea090d14c45d5a2f846db3cb223eb as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/c99ea090d14c45d5a2f846db3cb223eb 2023-02-11 19:56:20,217 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/c99ea090d14c45d5a2f846db3cb223eb, entries=4, sequenceid=13, filesize=5.5 K 2023-02-11 19:56:20,218 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp/family2/8c58c360741d43eda46d9a15a261a907 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/8c58c360741d43eda46d9a15a261a907 2023-02-11 19:56:20,221 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/8c58c360741d43eda46d9a15a261a907, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 19:56:20,222 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c4cc5915c5085f6b3ca4eeb5d49aac69 in 1783ms, sequenceid=13, compaction requested=true 2023-02-11 19:56:20,222 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c4cc5915c5085f6b3ca4eeb5d49aac69: 2023-02-11 19:56:20,222 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:20,222 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 19:56:20,222 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 19:56:20,222 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:20,222 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-11 19:56:20,222 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-11 19:56:20,223 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:20,223 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:20,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:20,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:20,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:20,224 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:20,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:20,224 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:56:20,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:20,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:20,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:20,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:20,225 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-11 19:56:20,225 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@463893a5[Count = 0] remaining members to acquire global barrier 2023-02-11 19:56:20,225 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-11 19:56:20,225 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:20,227 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:20,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:20,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:20,227 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-11 19:56:20,227 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-11 19:56:20,228 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:56:20,228 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:20,228 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:56:20,229 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-11 19:56:20,229 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:20,229 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:20,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:20,229 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-11 19:56:20,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:20,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:20,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:20,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:20,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:20,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:20,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:20,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:20,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:20,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:56:20,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-11 19:56:20,232 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-11 19:56:20,232 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:56:20,232 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:56:20,232 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-11 19:56:20,232 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:56:20,233 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:20,233 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:20,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:20,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:20,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:20,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:20,233 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:20,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:20,234 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:20,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:20,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:20,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:20,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:20,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:20,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:20,235 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:20,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:20,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:20,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:20,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:20,237 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:20,237 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:20,237 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:20,237 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-11 19:56:20,237 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:56:20,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:20,237 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:20,237 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:20,237 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-11 19:56:20,237 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:20,237 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:56:20,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:20,237 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-11 19:56:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:20,237 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:20,237 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:20,238 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:20,238 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:20,337 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:56:20,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:56:20,339 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:56:20,339 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:56:20,340 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 19:56:20,342 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:56:20,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-11 19:56:20,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-11 19:56:20,344 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-11 19:56:20,344 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:20,344 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-11 19:56:20,344 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-11 19:56:20,344 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:20,344 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:20,349 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:20,349 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:20,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:20,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:20,350 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:20,350 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:56:20,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:20,350 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:20,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:56:20,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:20,350 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-11 19:56:20,351 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-11 19:56:20,351 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-11 19:56:20,351 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-11 19:56:20,351 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:20,351 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-11 19:56:20,351 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:20,351 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. started... 2023-02-11 19:56:20,351 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:20,351 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. started... 2023-02-11 19:56:20,351 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:20,351 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 19:56:20,351 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:56:20,351 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c4cc5915c5085f6b3ca4eeb5d49aac69 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 19:56:20,351 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. started... 2023-02-11 19:56:20,351 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7fade4c8a6079ee1828f4aac4df78b5e 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 19:56:20,351 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1b36fb7c48b67f7a86dd4a8ca5d25e59 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 19:56:20,800 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302113cc76b7d290a42aea85fdcc170b137b4 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302113cc76b7d290a42aea85fdcc170b137b4 2023-02-11 19:56:20,806 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211f031b50799664a70b62a2e83a16f9122 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230211f031b50799664a70b62a2e83a16f9122 2023-02-11 19:56:20,809 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211e6925e0f6fd7490c8053d2205ecc2051 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211e6925e0f6fd7490c8053d2205ecc2051 2023-02-11 19:56:20,821 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp/family1/d6d6140e857e486ea72f221f9233f1ed 2023-02-11 19:56:20,823 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp/family1/ec05a6622a5241d4aaab5733921e211f 2023-02-11 19:56:21,221 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp/family1/efd787c9fbac4e9daa50c2c695c2d851 2023-02-11 19:56:21,255 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211dcf7e8c47c614ac7baf92b0d19ce0d90 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230211dcf7e8c47c614ac7baf92b0d19ce0d90 2023-02-11 19:56:21,264 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021120ed5fcf8c5c4efc878b17268c6c92b4 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023021120ed5fcf8c5c4efc878b17268c6c92b4 2023-02-11 19:56:21,652 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211acc5f1650b524c7eace5fc11cfca9991 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230211acc5f1650b524c7eace5fc11cfca9991 2023-02-11 19:56:21,660 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp/family2/95bb610dfad843db967a66f0bda24e27 2023-02-11 19:56:21,663 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp/family1/ec05a6622a5241d4aaab5733921e211f as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/ec05a6622a5241d4aaab5733921e211f 2023-02-11 19:56:21,673 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp/family2/9f48fc95c5e1421db6eeddf59db37830 2023-02-11 19:56:21,677 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp/family1/d6d6140e857e486ea72f221f9233f1ed as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/d6d6140e857e486ea72f221f9233f1ed 2023-02-11 19:56:21,686 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/ec05a6622a5241d4aaab5733921e211f, entries=4, sequenceid=17, filesize=5.5 K 2023-02-11 19:56:21,686 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp/family2/95bb610dfad843db967a66f0bda24e27 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/95bb610dfad843db967a66f0bda24e27 2023-02-11 19:56:21,690 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/95bb610dfad843db967a66f0bda24e27, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 19:56:21,690 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 7fade4c8a6079ee1828f4aac4df78b5e in 1339ms, sequenceid=17, compaction requested=true 2023-02-11 19:56:21,690 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7fade4c8a6079ee1828f4aac4df78b5e: 2023-02-11 19:56:21,690 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:21,691 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 19:56:21,711 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/d6d6140e857e486ea72f221f9233f1ed, entries=4, sequenceid=17, filesize=5.5 K 2023-02-11 19:56:21,711 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp/family2/9f48fc95c5e1421db6eeddf59db37830 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/9f48fc95c5e1421db6eeddf59db37830 2023-02-11 19:56:21,715 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/9f48fc95c5e1421db6eeddf59db37830, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 19:56:21,716 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c4cc5915c5085f6b3ca4eeb5d49aac69 in 1365ms, sequenceid=17, compaction requested=true 2023-02-11 19:56:21,716 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c4cc5915c5085f6b3ca4eeb5d49aac69: 2023-02-11 19:56:21,716 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:21,716 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 19:56:22,057 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp/family2/1728805568f641038c714235793bafd1 2023-02-11 19:56:22,061 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp/family1/efd787c9fbac4e9daa50c2c695c2d851 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/efd787c9fbac4e9daa50c2c695c2d851 2023-02-11 19:56:22,083 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/efd787c9fbac4e9daa50c2c695c2d851, entries=4, sequenceid=17, filesize=5.5 K 2023-02-11 19:56:22,084 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp/family2/1728805568f641038c714235793bafd1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/1728805568f641038c714235793bafd1 2023-02-11 19:56:22,087 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/1728805568f641038c714235793bafd1, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 19:56:22,088 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 1b36fb7c48b67f7a86dd4a8ca5d25e59 in 1737ms, sequenceid=17, compaction requested=true 2023-02-11 19:56:22,088 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1b36fb7c48b67f7a86dd4a8ca5d25e59: 2023-02-11 19:56:22,088 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:22,088 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 19:56:22,088 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 19:56:22,088 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:22,088 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-11 19:56:22,088 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-11 19:56:22,090 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:22,090 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:22,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:22,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:22,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:22,090 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:22,090 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:56:22,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:22,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:22,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:22,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:22,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:22,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-11 19:56:22,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27e07407[Count = 0] remaining members to acquire global barrier 2023-02-11 19:56:22,091 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-11 19:56:22,092 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:22,093 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:22,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:22,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:22,093 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-11 19:56:22,093 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-11 19:56:22,093 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:22,093 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:56:22,093 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:56:22,094 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:22,094 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-11 19:56:22,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:22,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:22,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:22,094 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:22,094 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-11 19:56:22,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:22,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:22,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:22,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:22,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:22,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:22,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:22,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:56:22,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-11 19:56:22,096 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-11 19:56:22,096 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:56:22,096 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:56:22,096 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-11 19:56:22,096 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:56:22,098 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:22,098 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:22,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:22,098 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:22,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:22,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:22,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:22,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:22,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:22,099 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:22,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:22,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:22,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:22,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:22,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:22,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:22,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:22,100 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:22,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:22,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:22,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:22,102 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:22,102 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:22,102 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:22,102 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:22,102 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:22,102 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:22,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:22,102 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:22,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:22,102 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-11 19:56:22,102 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:56:22,102 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:22,102 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:22,102 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:22,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:22,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:22,102 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-11 19:56:22,102 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:56:22,203 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:56:22,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:56:22,211 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 19:56:22,219 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 19:56:22,227 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 19:56:22,228 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 19:56:22,312 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:56:22,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-11 19:56:22,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-11 19:56:22,315 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-11 19:56:22,315 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:22,315 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-11 19:56:22,315 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-11 19:56:22,315 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:22,315 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:22,316 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:22,316 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:22,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:22,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:22,317 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:22,317 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:56:22,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:22,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:22,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:56:22,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:22,317 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-11 19:56:22,318 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-11 19:56:22,318 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-11 19:56:22,318 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-11 19:56:22,318 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:56:22,318 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-11 19:56:22,318 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:22,318 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. started... 2023-02-11 19:56:22,318 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7fade4c8a6079ee1828f4aac4df78b5e 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 19:56:22,320 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:22,320 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. started... 2023-02-11 19:56:22,320 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c4cc5915c5085f6b3ca4eeb5d49aac69 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 19:56:22,323 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 19:56:22,323 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:56:22,323 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:22,324 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. started... 2023-02-11 19:56:22,324 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1b36fb7c48b67f7a86dd4a8ca5d25e59 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 19:56:22,773 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp/family1/c13429048b64427491c3d056fe8e57cc 2023-02-11 19:56:22,773 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp/family1/c344ea7646e84454b2025e1aca3137fb 2023-02-11 19:56:22,796 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c13429048b64427491c3d056fe8e57cc 2023-02-11 19:56:22,796 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c344ea7646e84454b2025e1aca3137fb 2023-02-11 19:56:23,169 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp/family1/cfdfb351dd754f6aac2d90e0acb42d60 2023-02-11 19:56:23,192 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cfdfb351dd754f6aac2d90e0acb42d60 2023-02-11 19:56:23,615 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp/family2/4373ca796a774f8bb9e3d3af2d19fdc2 2023-02-11 19:56:23,615 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp/family2/64645ecd253045e99791d5de3d8d51d6 2023-02-11 19:56:23,618 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4373ca796a774f8bb9e3d3af2d19fdc2 2023-02-11 19:56:23,618 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64645ecd253045e99791d5de3d8d51d6 2023-02-11 19:56:23,618 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp/family1/c344ea7646e84454b2025e1aca3137fb as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/c344ea7646e84454b2025e1aca3137fb 2023-02-11 19:56:23,619 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp/family1/c13429048b64427491c3d056fe8e57cc as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/c13429048b64427491c3d056fe8e57cc 2023-02-11 19:56:23,641 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c344ea7646e84454b2025e1aca3137fb 2023-02-11 19:56:23,641 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/c344ea7646e84454b2025e1aca3137fb, entries=3, sequenceid=23, filesize=5.2 K 2023-02-11 19:56:23,642 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp/family2/4373ca796a774f8bb9e3d3af2d19fdc2 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/4373ca796a774f8bb9e3d3af2d19fdc2 2023-02-11 19:56:23,645 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4373ca796a774f8bb9e3d3af2d19fdc2 2023-02-11 19:56:23,645 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/4373ca796a774f8bb9e3d3af2d19fdc2, entries=1, sequenceid=23, filesize=5.0 K 2023-02-11 19:56:23,645 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c4cc5915c5085f6b3ca4eeb5d49aac69 in 1325ms, sequenceid=23, compaction requested=true 2023-02-11 19:56:23,646 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c4cc5915c5085f6b3ca4eeb5d49aac69: 2023-02-11 19:56:23,646 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:23,646 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 19:56:23,652 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c13429048b64427491c3d056fe8e57cc 2023-02-11 19:56:23,652 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/c13429048b64427491c3d056fe8e57cc, entries=3, sequenceid=23, filesize=5.2 K 2023-02-11 19:56:23,653 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp/family2/64645ecd253045e99791d5de3d8d51d6 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/64645ecd253045e99791d5de3d8d51d6 2023-02-11 19:56:23,656 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64645ecd253045e99791d5de3d8d51d6 2023-02-11 19:56:23,657 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/64645ecd253045e99791d5de3d8d51d6, entries=1, sequenceid=23, filesize=5.0 K 2023-02-11 19:56:23,657 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 7fade4c8a6079ee1828f4aac4df78b5e in 1339ms, sequenceid=23, compaction requested=true 2023-02-11 19:56:23,657 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7fade4c8a6079ee1828f4aac4df78b5e: 2023-02-11 19:56:23,657 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:23,657 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 19:56:24,003 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp/family2/2cd1c69004404382a2895e98a93a2ccb 2023-02-11 19:56:24,007 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2cd1c69004404382a2895e98a93a2ccb 2023-02-11 19:56:24,008 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp/family1/cfdfb351dd754f6aac2d90e0acb42d60 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/cfdfb351dd754f6aac2d90e0acb42d60 2023-02-11 19:56:24,030 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cfdfb351dd754f6aac2d90e0acb42d60 2023-02-11 19:56:24,030 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/cfdfb351dd754f6aac2d90e0acb42d60, entries=3, sequenceid=23, filesize=5.2 K 2023-02-11 19:56:24,030 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp/family2/2cd1c69004404382a2895e98a93a2ccb as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/2cd1c69004404382a2895e98a93a2ccb 2023-02-11 19:56:24,034 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2cd1c69004404382a2895e98a93a2ccb 2023-02-11 19:56:24,034 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/2cd1c69004404382a2895e98a93a2ccb, entries=1, sequenceid=23, filesize=5.0 K 2023-02-11 19:56:24,034 INFO [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 1b36fb7c48b67f7a86dd4a8ca5d25e59 in 1710ms, sequenceid=23, compaction requested=true 2023-02-11 19:56:24,034 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1b36fb7c48b67f7a86dd4a8ca5d25e59: 2023-02-11 19:56:24,034 DEBUG [rs(jenkins-hbase4.apache.org,45897,1676145215747)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:24,035 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 19:56:24,035 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 19:56:24,035 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:24,035 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-11 19:56:24,035 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-11 19:56:24,036 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:24,036 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:24,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:24,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:24,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:24,036 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:24,036 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:56:24,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:24,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:24,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:24,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:24,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:24,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45897,1676145215747' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-11 19:56:24,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d740382[Count = 0] remaining members to acquire global barrier 2023-02-11 19:56:24,038 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-11 19:56:24,038 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:24,040 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:24,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:24,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:24,040 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-11 19:56:24,040 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-11 19:56:24,040 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,45897,1676145215747' in zk 2023-02-11 19:56:24,040 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:24,040 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:56:24,041 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-11 19:56:24,041 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:24,041 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:24,041 DEBUG [member: 'jenkins-hbase4.apache.org,45897,1676145215747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-11 19:56:24,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:24,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:24,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:24,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:24,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:24,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:24,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:24,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:24,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:24,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:24,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,45897,1676145215747': 2023-02-11 19:56:24,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45897,1676145215747' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-11 19:56:24,043 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-11 19:56:24,044 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:56:24,044 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:56:24,044 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-11 19:56:24,044 INFO [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:56:24,045 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:24,045 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:24,045 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:24,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:24,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:24,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:56:24,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:56:24,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:24,045 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:24,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:56:24,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:24,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:24,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:24,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:24,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:56:24,046 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:24,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:24,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:24,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:56:24,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 19:56:24,048 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:24,048 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:24,048 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 19:56:24,048 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:24,048 DEBUG [(jenkins-hbase4.apache.org,40445,1676145214633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:56:24,048 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:24,049 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:56:24,049 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:56:24,048 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-11 19:56:24,049 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:56:24,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-11 19:56:24,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:56:24,049 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 19:56:24,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:56:24,049 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 19:56:24,049 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-11 19:56:24,049 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:56:24,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:56:24,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:56:24,149 DEBUG [Listener at localhost/32929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:56:24,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40445] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:56:24,151 DEBUG [Listener at localhost/32929] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 19:56:24,151 DEBUG [Listener at localhost/32929] regionserver.HStore(1912): 7fade4c8a6079ee1828f4aac4df78b5e/family1 is initiating major compaction (all files) 2023-02-11 19:56:24,151 INFO [Listener at localhost/32929] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:56:24,151 INFO [Listener at localhost/32929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:56:24,152 INFO [Listener at localhost/32929] regionserver.HRegion(2258): Starting compaction of 7fade4c8a6079ee1828f4aac4df78b5e/family1 in testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:24,152 INFO [Listener at localhost/32929] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/ea3838aa61794c00bc5fbb6e9901bc50, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/db6306c86ee6444ca21ab07b62b2d91d, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/b56cc55c79664bdb8e2854f7fe2f7e45, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/ec05a6622a5241d4aaab5733921e211f, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/c13429048b64427491c3d056fe8e57cc] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp, totalSize=27.1 K 2023-02-11 19:56:24,153 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting ea3838aa61794c00bc5fbb6e9901bc50, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145374685 2023-02-11 19:56:24,153 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting db6306c86ee6444ca21ab07b62b2d91d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145376554 2023-02-11 19:56:24,154 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting b56cc55c79664bdb8e2854f7fe2f7e45, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145378431 2023-02-11 19:56:24,154 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting ec05a6622a5241d4aaab5733921e211f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145380339 2023-02-11 19:56:24,154 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting c13429048b64427491c3d056fe8e57cc, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 19:56:24,163 INFO [Listener at localhost/32929] throttle.PressureAwareThroughputController(145): 7fade4c8a6079ee1828f4aac4df78b5e#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:56:24,606 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021122885660d4d24ad69b38164c8604e3ff_del 2023-02-11 19:56:24,606 INFO [Listener at localhost/32929] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021122885660d4d24ad69b38164c8604e3ff_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021122885660d4d24ad69b38164c8604e3ff_del 2023-02-11 19:56:25,457 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6dd1d4fd6be548bdbc6a84aeb04bdc8c 2023-02-11 19:56:25,458 DEBUG [Listener at localhost/32929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp/family1/6dd1d4fd6be548bdbc6a84aeb04bdc8c as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/6dd1d4fd6be548bdbc6a84aeb04bdc8c 2023-02-11 19:56:25,479 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6dd1d4fd6be548bdbc6a84aeb04bdc8c 2023-02-11 19:56:25,480 INFO [Listener at localhost/32929] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7fade4c8a6079ee1828f4aac4df78b5e/family1 of 7fade4c8a6079ee1828f4aac4df78b5e into 6dd1d4fd6be548bdbc6a84aeb04bdc8c(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 19:56:25,480 DEBUG [Listener at localhost/32929] regionserver.HRegion(2288): Compaction status journal for 7fade4c8a6079ee1828f4aac4df78b5e: 2023-02-11 19:56:25,480 DEBUG [Listener at localhost/32929] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 19:56:25,481 DEBUG [Listener at localhost/32929] regionserver.HStore(1912): 7fade4c8a6079ee1828f4aac4df78b5e/family2 is initiating major compaction (all files) 2023-02-11 19:56:25,481 INFO [Listener at localhost/32929] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:56:25,481 INFO [Listener at localhost/32929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:56:25,482 INFO [Listener at localhost/32929] regionserver.HRegion(2258): Starting compaction of 7fade4c8a6079ee1828f4aac4df78b5e/family2 in testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:25,483 INFO [Listener at localhost/32929] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/574d7a31ca6d47ba8e7b671a87bbce6c, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/77c347949b224d4cbee381f124f819e7, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/a35a45513b5e4073b493090768db8fd2, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/95bb610dfad843db967a66f0bda24e27, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/64645ecd253045e99791d5de3d8d51d6] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp, totalSize=25.4 K 2023-02-11 19:56:25,483 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 574d7a31ca6d47ba8e7b671a87bbce6c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145374685 2023-02-11 19:56:25,483 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 77c347949b224d4cbee381f124f819e7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145376554 2023-02-11 19:56:25,484 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting a35a45513b5e4073b493090768db8fd2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145378431 2023-02-11 19:56:25,484 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 95bb610dfad843db967a66f0bda24e27, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145380339 2023-02-11 19:56:25,484 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 64645ecd253045e99791d5de3d8d51d6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 19:56:25,491 INFO [Listener at localhost/32929] throttle.PressureAwareThroughputController(145): 7fade4c8a6079ee1828f4aac4df78b5e#family2#compaction#199 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:56:25,501 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302119cb5aea170a943649be336e183aab6df_del 2023-02-11 19:56:25,501 INFO [Listener at localhost/32929] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302119cb5aea170a943649be336e183aab6df_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302119cb5aea170a943649be336e183aab6df_del 2023-02-11 19:56:25,534 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/ea3838aa61794c00bc5fbb6e9901bc50, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/db6306c86ee6444ca21ab07b62b2d91d, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/b56cc55c79664bdb8e2854f7fe2f7e45, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/ec05a6622a5241d4aaab5733921e211f, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/c13429048b64427491c3d056fe8e57cc] to archive 2023-02-11 19:56:25,535 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:56:25,536 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/ea3838aa61794c00bc5fbb6e9901bc50 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/ea3838aa61794c00bc5fbb6e9901bc50 2023-02-11 19:56:25,537 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/db6306c86ee6444ca21ab07b62b2d91d to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/db6306c86ee6444ca21ab07b62b2d91d 2023-02-11 19:56:25,538 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/b56cc55c79664bdb8e2854f7fe2f7e45 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/b56cc55c79664bdb8e2854f7fe2f7e45 2023-02-11 19:56:25,539 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/ec05a6622a5241d4aaab5733921e211f to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/ec05a6622a5241d4aaab5733921e211f 2023-02-11 19:56:25,540 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/c13429048b64427491c3d056fe8e57cc to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/c13429048b64427491c3d056fe8e57cc 2023-02-11 19:56:25,911 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4d06c9f880e84850b6bf65d70625078a 2023-02-11 19:56:25,912 DEBUG [Listener at localhost/32929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/.tmp/family2/4d06c9f880e84850b6bf65d70625078a as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/4d06c9f880e84850b6bf65d70625078a 2023-02-11 19:56:25,916 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4d06c9f880e84850b6bf65d70625078a 2023-02-11 19:56:25,917 INFO [Listener at localhost/32929] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7fade4c8a6079ee1828f4aac4df78b5e/family2 of 7fade4c8a6079ee1828f4aac4df78b5e into 4d06c9f880e84850b6bf65d70625078a(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 19:56:25,917 DEBUG [Listener at localhost/32929] regionserver.HRegion(2288): Compaction status journal for 7fade4c8a6079ee1828f4aac4df78b5e: 2023-02-11 19:56:25,917 DEBUG [Listener at localhost/32929] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 19:56:25,917 DEBUG [Listener at localhost/32929] regionserver.HStore(1912): c4cc5915c5085f6b3ca4eeb5d49aac69/family1 is initiating major compaction (all files) 2023-02-11 19:56:25,917 INFO [Listener at localhost/32929] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:56:25,918 INFO [Listener at localhost/32929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:56:25,918 INFO [Listener at localhost/32929] regionserver.HRegion(2258): Starting compaction of c4cc5915c5085f6b3ca4eeb5d49aac69/family1 in testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:25,918 INFO [Listener at localhost/32929] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/aae869c8fecc4a668d6893f8559f92b0, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/89641649cd254bbe843b50723f5e3431, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/c99ea090d14c45d5a2f846db3cb223eb, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/d6d6140e857e486ea72f221f9233f1ed, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/c344ea7646e84454b2025e1aca3137fb] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp, totalSize=27.1 K 2023-02-11 19:56:25,918 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting aae869c8fecc4a668d6893f8559f92b0, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145374685 2023-02-11 19:56:25,918 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 89641649cd254bbe843b50723f5e3431, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145376554 2023-02-11 19:56:25,919 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting c99ea090d14c45d5a2f846db3cb223eb, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145378431 2023-02-11 19:56:25,919 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting d6d6140e857e486ea72f221f9233f1ed, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145380340 2023-02-11 19:56:25,919 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting c344ea7646e84454b2025e1aca3137fb, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 19:56:25,927 INFO [Listener at localhost/32929] throttle.PressureAwareThroughputController(145): c4cc5915c5085f6b3ca4eeb5d49aac69#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:56:25,934 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/574d7a31ca6d47ba8e7b671a87bbce6c, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/77c347949b224d4cbee381f124f819e7, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/a35a45513b5e4073b493090768db8fd2, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/95bb610dfad843db967a66f0bda24e27, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/64645ecd253045e99791d5de3d8d51d6] to archive 2023-02-11 19:56:25,934 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:56:25,936 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/574d7a31ca6d47ba8e7b671a87bbce6c to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/574d7a31ca6d47ba8e7b671a87bbce6c 2023-02-11 19:56:25,937 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/77c347949b224d4cbee381f124f819e7 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/77c347949b224d4cbee381f124f819e7 2023-02-11 19:56:25,938 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/a35a45513b5e4073b493090768db8fd2 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/a35a45513b5e4073b493090768db8fd2 2023-02-11 19:56:25,939 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/95bb610dfad843db967a66f0bda24e27 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/95bb610dfad843db967a66f0bda24e27 2023-02-11 19:56:25,940 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/64645ecd253045e99791d5de3d8d51d6 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family2/64645ecd253045e99791d5de3d8d51d6 2023-02-11 19:56:25,962 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023021184cd37017a35429cb7a0390a7b4306d8_del 2023-02-11 19:56:25,962 INFO [Listener at localhost/32929] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021184cd37017a35429cb7a0390a7b4306d8_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021184cd37017a35429cb7a0390a7b4306d8_del 2023-02-11 19:56:26,814 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d16dc9c21d446e1a5c188fa5fe1f618 2023-02-11 19:56:26,815 DEBUG [Listener at localhost/32929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp/family1/1d16dc9c21d446e1a5c188fa5fe1f618 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/1d16dc9c21d446e1a5c188fa5fe1f618 2023-02-11 19:56:26,836 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d16dc9c21d446e1a5c188fa5fe1f618 2023-02-11 19:56:26,837 INFO [Listener at localhost/32929] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c4cc5915c5085f6b3ca4eeb5d49aac69/family1 of c4cc5915c5085f6b3ca4eeb5d49aac69 into 1d16dc9c21d446e1a5c188fa5fe1f618(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 19:56:26,837 DEBUG [Listener at localhost/32929] regionserver.HRegion(2288): Compaction status journal for c4cc5915c5085f6b3ca4eeb5d49aac69: 2023-02-11 19:56:26,837 DEBUG [Listener at localhost/32929] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 19:56:26,837 DEBUG [Listener at localhost/32929] regionserver.HStore(1912): c4cc5915c5085f6b3ca4eeb5d49aac69/family2 is initiating major compaction (all files) 2023-02-11 19:56:26,837 INFO [Listener at localhost/32929] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:56:26,837 INFO [Listener at localhost/32929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:56:26,838 INFO [Listener at localhost/32929] regionserver.HRegion(2258): Starting compaction of c4cc5915c5085f6b3ca4eeb5d49aac69/family2 in testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:26,838 INFO [Listener at localhost/32929] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/78498d4f9d604d1c8f8aa08dfc689bd2, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/328b360a45ce4f14b84253dec34c5327, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/8c58c360741d43eda46d9a15a261a907, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/9f48fc95c5e1421db6eeddf59db37830, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/4373ca796a774f8bb9e3d3af2d19fdc2] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp, totalSize=25.4 K 2023-02-11 19:56:26,838 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 78498d4f9d604d1c8f8aa08dfc689bd2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145374685 2023-02-11 19:56:26,839 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 328b360a45ce4f14b84253dec34c5327, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145376554 2023-02-11 19:56:26,839 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 8c58c360741d43eda46d9a15a261a907, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145378431 2023-02-11 19:56:26,839 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 9f48fc95c5e1421db6eeddf59db37830, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145380340 2023-02-11 19:56:26,839 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 4373ca796a774f8bb9e3d3af2d19fdc2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 19:56:26,846 INFO [Listener at localhost/32929] throttle.PressureAwareThroughputController(145): c4cc5915c5085f6b3ca4eeb5d49aac69#family2#compaction#201 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:56:26,934 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/aae869c8fecc4a668d6893f8559f92b0, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/89641649cd254bbe843b50723f5e3431, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/c99ea090d14c45d5a2f846db3cb223eb, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/d6d6140e857e486ea72f221f9233f1ed, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/c344ea7646e84454b2025e1aca3137fb] to archive 2023-02-11 19:56:26,935 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:56:26,936 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/aae869c8fecc4a668d6893f8559f92b0 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/aae869c8fecc4a668d6893f8559f92b0 2023-02-11 19:56:26,937 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/89641649cd254bbe843b50723f5e3431 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/89641649cd254bbe843b50723f5e3431 2023-02-11 19:56:26,938 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/c99ea090d14c45d5a2f846db3cb223eb to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/c99ea090d14c45d5a2f846db3cb223eb 2023-02-11 19:56:26,939 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/d6d6140e857e486ea72f221f9233f1ed to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/d6d6140e857e486ea72f221f9233f1ed 2023-02-11 19:56:26,940 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/c344ea7646e84454b2025e1aca3137fb to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/c344ea7646e84454b2025e1aca3137fb 2023-02-11 19:56:27,253 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302114d6f99a6e3d240e29101a19762cfe69a_del 2023-02-11 19:56:27,254 INFO [Listener at localhost/32929] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302114d6f99a6e3d240e29101a19762cfe69a_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202302114d6f99a6e3d240e29101a19762cfe69a_del 2023-02-11 19:56:28,066 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a05a74139704ec482884962a5730ea7 2023-02-11 19:56:28,067 DEBUG [Listener at localhost/32929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/.tmp/family2/6a05a74139704ec482884962a5730ea7 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/6a05a74139704ec482884962a5730ea7 2023-02-11 19:56:28,070 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a05a74139704ec482884962a5730ea7 2023-02-11 19:56:28,071 INFO [Listener at localhost/32929] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c4cc5915c5085f6b3ca4eeb5d49aac69/family2 of c4cc5915c5085f6b3ca4eeb5d49aac69 into 6a05a74139704ec482884962a5730ea7(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 19:56:28,071 DEBUG [Listener at localhost/32929] regionserver.HRegion(2288): Compaction status journal for c4cc5915c5085f6b3ca4eeb5d49aac69: 2023-02-11 19:56:28,071 DEBUG [Listener at localhost/32929] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 19:56:28,071 DEBUG [Listener at localhost/32929] regionserver.HStore(1912): 1b36fb7c48b67f7a86dd4a8ca5d25e59/family1 is initiating major compaction (all files) 2023-02-11 19:56:28,071 INFO [Listener at localhost/32929] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:56:28,071 INFO [Listener at localhost/32929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:56:28,072 INFO [Listener at localhost/32929] regionserver.HRegion(2258): Starting compaction of 1b36fb7c48b67f7a86dd4a8ca5d25e59/family1 in testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:28,072 INFO [Listener at localhost/32929] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/7431b4cb65ad4642a2b24cc2fa22d42d, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/10074e58727c4dd88025b6905b7c45da, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/dcfbb9e5b536417191f843bd3e809404, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/efd787c9fbac4e9daa50c2c695c2d851, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/cfdfb351dd754f6aac2d90e0acb42d60] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp, totalSize=27.1 K 2023-02-11 19:56:28,072 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 7431b4cb65ad4642a2b24cc2fa22d42d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145374684 2023-02-11 19:56:28,072 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 10074e58727c4dd88025b6905b7c45da, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145376553 2023-02-11 19:56:28,073 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting dcfbb9e5b536417191f843bd3e809404, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145378431 2023-02-11 19:56:28,073 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting efd787c9fbac4e9daa50c2c695c2d851, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145380339 2023-02-11 19:56:28,073 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting cfdfb351dd754f6aac2d90e0acb42d60, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 19:56:28,079 INFO [Listener at localhost/32929] throttle.PressureAwareThroughputController(145): 1b36fb7c48b67f7a86dd4a8ca5d25e59#family1#compaction#202 average throughput is 1.72 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:56:28,127 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302111162074b98624f50bc4b7f509a121684_del 2023-02-11 19:56:28,127 INFO [Listener at localhost/32929] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302111162074b98624f50bc4b7f509a121684_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302111162074b98624f50bc4b7f509a121684_del 2023-02-11 19:56:28,135 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/78498d4f9d604d1c8f8aa08dfc689bd2, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/328b360a45ce4f14b84253dec34c5327, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/8c58c360741d43eda46d9a15a261a907, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/9f48fc95c5e1421db6eeddf59db37830, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/4373ca796a774f8bb9e3d3af2d19fdc2] to archive 2023-02-11 19:56:28,136 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:56:28,137 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/78498d4f9d604d1c8f8aa08dfc689bd2 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/78498d4f9d604d1c8f8aa08dfc689bd2 2023-02-11 19:56:28,138 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/328b360a45ce4f14b84253dec34c5327 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/328b360a45ce4f14b84253dec34c5327 2023-02-11 19:56:28,139 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/8c58c360741d43eda46d9a15a261a907 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/8c58c360741d43eda46d9a15a261a907 2023-02-11 19:56:28,140 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/9f48fc95c5e1421db6eeddf59db37830 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/9f48fc95c5e1421db6eeddf59db37830 2023-02-11 19:56:28,141 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/4373ca796a774f8bb9e3d3af2d19fdc2 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family2/4373ca796a774f8bb9e3d3af2d19fdc2 2023-02-11 19:56:28,978 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f6df2b597cc049e5b9632ced49cdd9e4 2023-02-11 19:56:28,979 DEBUG [Listener at localhost/32929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp/family1/f6df2b597cc049e5b9632ced49cdd9e4 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/f6df2b597cc049e5b9632ced49cdd9e4 2023-02-11 19:56:29,000 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f6df2b597cc049e5b9632ced49cdd9e4 2023-02-11 19:56:29,001 INFO [Listener at localhost/32929] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1b36fb7c48b67f7a86dd4a8ca5d25e59/family1 of 1b36fb7c48b67f7a86dd4a8ca5d25e59 into f6df2b597cc049e5b9632ced49cdd9e4(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 19:56:29,002 DEBUG [Listener at localhost/32929] regionserver.HRegion(2288): Compaction status journal for 1b36fb7c48b67f7a86dd4a8ca5d25e59: 2023-02-11 19:56:29,002 DEBUG [Listener at localhost/32929] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 19:56:29,002 DEBUG [Listener at localhost/32929] regionserver.HStore(1912): 1b36fb7c48b67f7a86dd4a8ca5d25e59/family2 is initiating major compaction (all files) 2023-02-11 19:56:29,002 INFO [Listener at localhost/32929] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:56:29,002 INFO [Listener at localhost/32929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:56:29,003 INFO [Listener at localhost/32929] regionserver.HRegion(2258): Starting compaction of 1b36fb7c48b67f7a86dd4a8ca5d25e59/family2 in testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:29,003 INFO [Listener at localhost/32929] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/19e77d104d38441fbbd84507ef429d68, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/06c648413a6d4f349c5f888513d11c1f, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/fadf07f974434b6a837db1cd5f91a893, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/1728805568f641038c714235793bafd1, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/2cd1c69004404382a2895e98a93a2ccb] into tmpdir=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp, totalSize=25.4 K 2023-02-11 19:56:29,003 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 19e77d104d38441fbbd84507ef429d68, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676145374684 2023-02-11 19:56:29,003 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 06c648413a6d4f349c5f888513d11c1f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676145376553 2023-02-11 19:56:29,004 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting fadf07f974434b6a837db1cd5f91a893, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676145378431 2023-02-11 19:56:29,004 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 1728805568f641038c714235793bafd1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676145380339 2023-02-11 19:56:29,004 DEBUG [Listener at localhost/32929] compactions.Compactor(207): Compacting 2cd1c69004404382a2895e98a93a2ccb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 19:56:29,012 INFO [Listener at localhost/32929] throttle.PressureAwareThroughputController(145): 1b36fb7c48b67f7a86dd4a8ca5d25e59#family2#compaction#203 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 19:56:29,018 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302116be065cc38bc4a999b3324ac93ecef7f_del 2023-02-11 19:56:29,018 INFO [Listener at localhost/32929] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302116be065cc38bc4a999b3324ac93ecef7f_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202302116be065cc38bc4a999b3324ac93ecef7f_del 2023-02-11 19:56:29,034 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/7431b4cb65ad4642a2b24cc2fa22d42d, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/10074e58727c4dd88025b6905b7c45da, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/dcfbb9e5b536417191f843bd3e809404, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/efd787c9fbac4e9daa50c2c695c2d851, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/cfdfb351dd754f6aac2d90e0acb42d60] to archive 2023-02-11 19:56:29,035 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:56:29,036 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/7431b4cb65ad4642a2b24cc2fa22d42d to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/7431b4cb65ad4642a2b24cc2fa22d42d 2023-02-11 19:56:29,037 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/10074e58727c4dd88025b6905b7c45da to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/10074e58727c4dd88025b6905b7c45da 2023-02-11 19:56:29,037 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/dcfbb9e5b536417191f843bd3e809404 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/dcfbb9e5b536417191f843bd3e809404 2023-02-11 19:56:29,038 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/efd787c9fbac4e9daa50c2c695c2d851 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/efd787c9fbac4e9daa50c2c695c2d851 2023-02-11 19:56:29,039 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/cfdfb351dd754f6aac2d90e0acb42d60 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/cfdfb351dd754f6aac2d90e0acb42d60 2023-02-11 19:56:29,428 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1173faa57ef74d92b9e48be613d52ca5 2023-02-11 19:56:29,429 DEBUG [Listener at localhost/32929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/.tmp/family2/1173faa57ef74d92b9e48be613d52ca5 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/1173faa57ef74d92b9e48be613d52ca5 2023-02-11 19:56:29,431 INFO [Listener at localhost/32929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1173faa57ef74d92b9e48be613d52ca5 2023-02-11 19:56:29,432 INFO [Listener at localhost/32929] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1b36fb7c48b67f7a86dd4a8ca5d25e59/family2 of 1b36fb7c48b67f7a86dd4a8ca5d25e59 into 1173faa57ef74d92b9e48be613d52ca5(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 19:56:29,432 DEBUG [Listener at localhost/32929] regionserver.HRegion(2288): Compaction status journal for 1b36fb7c48b67f7a86dd4a8ca5d25e59: 2023-02-11 19:56:29,437 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 19:56:29,439 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 19:56:29,440 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/19e77d104d38441fbbd84507ef429d68, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/06c648413a6d4f349c5f888513d11c1f, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/fadf07f974434b6a837db1cd5f91a893, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/1728805568f641038c714235793bafd1, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/2cd1c69004404382a2895e98a93a2ccb] to archive 2023-02-11 19:56:29,441 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:56:29,442 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 19:56:29,443 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/19e77d104d38441fbbd84507ef429d68 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/19e77d104d38441fbbd84507ef429d68 2023-02-11 19:56:29,443 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 19:56:29,444 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/06c648413a6d4f349c5f888513d11c1f to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/06c648413a6d4f349c5f888513d11c1f 2023-02-11 19:56:29,445 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/fadf07f974434b6a837db1cd5f91a893 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/fadf07f974434b6a837db1cd5f91a893 2023-02-11 19:56:29,446 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/1728805568f641038c714235793bafd1 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/1728805568f641038c714235793bafd1 2023-02-11 19:56:29,447 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/2cd1c69004404382a2895e98a93a2ccb to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family2/2cd1c69004404382a2895e98a93a2ccb 2023-02-11 19:56:29,448 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40445] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x7F\xFC\xF7#\xC1\xDA\xD9'O\xCFr\xC1\xE1%\xA5M"\x10\xE6\xB3z\x9E\xE7\xB8@\xD3=\x1Ev\xE7\xF0\x03po*\x10KT\xF6/\xAC\xE3\xDF\x16\x95\xC6\xBEo,\xD7\x02\xA62\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-02-11 19:56:29,468 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-11 19:56:29,469 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-11 19:56:29,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:56:29,470 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676145989470 2023-02-11 19:56:29,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 19:56:29,796 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-02-11 19:56:29,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302111162074b98624f50bc4b7f509a121684_del 2023-02-11 19:56:29,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021122885660d4d24ad69b38164c8604e3ff_del 2023-02-11 19:56:29,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023021184cd37017a35429cb7a0390a7b4306d8_del 2023-02-11 19:56:29,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 19:56:29,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] zookeeper.ReadOnlyZKClient(139): Connect 0x4ccea4c9 to 127.0.0.1:64025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:56:29,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@115c232, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:56:29,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230211 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-11 19:56:30,830 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021111b67756e4494511a0ddeda9823e9441 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021111b67756e4494511a0ddeda9823e9441 2023-02-11 19:56:30,831 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 19:56:30,841 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:56:30,844 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60854, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:56:30,853 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:56:30,855 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58142, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:56:30,882 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230211/family1/97e221bef5b041e59379dc57b9646fbf first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-11 19:56:30,883 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230211/family1/97e221bef5b041e59379dc57b9646fbf}] 2023-02-11 19:56:30,889 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230211/family1/97e221bef5b041e59379dc57b9646fbf for inclusion in 7fade4c8a6079ee1828f4aac4df78b5e/family1 2023-02-11 19:56:30,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-11 19:56:30,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-11 19:56:30,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 7fade4c8a6079ee1828f4aac4df78b5e: 2023-02-11 19:56:30,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230211/family1/97e221bef5b041e59379dc57b9646fbf to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionFromAdmin__lavco0dvbcj6mb8617b63hpuh8ss0h129vjr6upuprhkm5oaqcrr0mcfl1s3644m/family1/97e221bef5b041e59379dc57b9646fbf 2023-02-11 19:56:30,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionFromAdmin__lavco0dvbcj6mb8617b63hpuh8ss0h129vjr6upuprhkm5oaqcrr0mcfl1s3644m/family1/97e221bef5b041e59379dc57b9646fbf as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/30fdcd0dc51d4b5bb8c4db809ec93695_SeqId_28_ 2023-02-11 19:56:30,913 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionFromAdmin__lavco0dvbcj6mb8617b63hpuh8ss0h129vjr6upuprhkm5oaqcrr0mcfl1s3644m/family1/97e221bef5b041e59379dc57b9646fbf into 7fade4c8a6079ee1828f4aac4df78b5e/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/30fdcd0dc51d4b5bb8c4db809ec93695_SeqId_28_ - updating store file list. 2023-02-11 19:56:30,934 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/30fdcd0dc51d4b5bb8c4db809ec93695_SeqId_28_ into 7fade4c8a6079ee1828f4aac4df78b5e/family1 2023-02-11 19:56:30,934 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionFromAdmin__lavco0dvbcj6mb8617b63hpuh8ss0h129vjr6upuprhkm5oaqcrr0mcfl1s3644m/family1/97e221bef5b041e59379dc57b9646fbf into 7fade4c8a6079ee1828f4aac4df78b5e/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/family1/30fdcd0dc51d4b5bb8c4db809ec93695_SeqId_28_) 2023-02-11 19:56:30,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionFromAdmin__lavco0dvbcj6mb8617b63hpuh8ss0h129vjr6upuprhkm5oaqcrr0mcfl1s3644m/family1/97e221bef5b041e59379dc57b9646fbf 2023-02-11 19:56:30,936 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 19:56:30,937 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:56:30,938 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211081200d0d1b44efcb7d6ff2c170f13e8 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211081200d0d1b44efcb7d6ff2c170f13e8 2023-02-11 19:56:30,939 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211ca3d84c52d9e4c8aa6e5a637ca67c4fe to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211ca3d84c52d9e4c8aa6e5a637ca67c4fe 2023-02-11 19:56:30,940 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211e6925e0f6fd7490c8053d2205ecc2051 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211e6925e0f6fd7490c8053d2205ecc2051 2023-02-11 19:56:30,940 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211fa1d3abcd2f242c1be47172bdaadeaca to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211fa1d3abcd2f242c1be47172bdaadeaca 2023-02-11 19:56:30,940 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-11 19:56:30,941 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230211' 2023-02-11 19:56:30,941 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230211 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-11 19:56:30,941 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230211 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-11 19:56:31,483 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211076f2b5a916d4dfd86a060ffdc1a7465 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211076f2b5a916d4dfd86a060ffdc1a7465 2023-02-11 19:56:31,485 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 19:56:31,531 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230211/family1/f085564d52ee42d4b9ddd2ba3496738f first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-11 19:56:31,532 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230211/family1/f085564d52ee42d4b9ddd2ba3496738f}] 2023-02-11 19:56:31,533 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230211/family1/f085564d52ee42d4b9ddd2ba3496738f for inclusion in c4cc5915c5085f6b3ca4eeb5d49aac69/family1 2023-02-11 19:56:31,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-11 19:56:31,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-11 19:56:31,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for c4cc5915c5085f6b3ca4eeb5d49aac69: 2023-02-11 19:56:31,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230211/family1/f085564d52ee42d4b9ddd2ba3496738f to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionFromAdmin__nqv1h3oataqo7omf8m84m4q88elsv3i04am6s3hjpqr691kkt97oc627g68uujqb/family1/f085564d52ee42d4b9ddd2ba3496738f 2023-02-11 19:56:31,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionFromAdmin__nqv1h3oataqo7omf8m84m4q88elsv3i04am6s3hjpqr691kkt97oc627g68uujqb/family1/f085564d52ee42d4b9ddd2ba3496738f as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/a61df7a525184908a8098e53bb169f0e_SeqId_28_ 2023-02-11 19:56:31,557 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionFromAdmin__nqv1h3oataqo7omf8m84m4q88elsv3i04am6s3hjpqr691kkt97oc627g68uujqb/family1/f085564d52ee42d4b9ddd2ba3496738f into c4cc5915c5085f6b3ca4eeb5d49aac69/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/a61df7a525184908a8098e53bb169f0e_SeqId_28_ - updating store file list. 2023-02-11 19:56:31,577 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/a61df7a525184908a8098e53bb169f0e_SeqId_28_ into c4cc5915c5085f6b3ca4eeb5d49aac69/family1 2023-02-11 19:56:31,578 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionFromAdmin__nqv1h3oataqo7omf8m84m4q88elsv3i04am6s3hjpqr691kkt97oc627g68uujqb/family1/f085564d52ee42d4b9ddd2ba3496738f into c4cc5915c5085f6b3ca4eeb5d49aac69/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/family1/a61df7a525184908a8098e53bb169f0e_SeqId_28_) 2023-02-11 19:56:31,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionFromAdmin__nqv1h3oataqo7omf8m84m4q88elsv3i04am6s3hjpqr691kkt97oc627g68uujqb/family1/f085564d52ee42d4b9ddd2ba3496738f 2023-02-11 19:56:31,580 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 19:56:31,580 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:56:31,581 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211363eab67dc7841519edfe08310180d36 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211363eab67dc7841519edfe08310180d36 2023-02-11 19:56:31,582 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302113cc76b7d290a42aea85fdcc170b137b4 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302113cc76b7d290a42aea85fdcc170b137b4 2023-02-11 19:56:31,583 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302115529de656beb4ec3b59f6b587be3d29f to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302115529de656beb4ec3b59f6b587be3d29f 2023-02-11 19:56:31,584 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211f7de6bba142c4180b1f41054440014a4 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211f7de6bba142c4180b1f41054440014a4 2023-02-11 19:56:31,584 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-11 19:56:31,584 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230211' 2023-02-11 19:56:31,584 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230211 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-11 19:56:31,584 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230211 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-11 19:56:32,137 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211aad08d66f8d64412963c521122a27dd3 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230211aad08d66f8d64412963c521122a27dd3 2023-02-11 19:56:32,138 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 19:56:32,183 DEBUG [regionserver/jenkins-hbase4:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-11 19:56:32,187 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230211/family1/0ac359c0608d440092b65fe62b8af434 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-11 19:56:32,188 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59., hostname=jenkins-hbase4.apache.org,45897,1676145215747, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230211/family1/0ac359c0608d440092b65fe62b8af434}] 2023-02-11 19:56:32,190 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(763): Validating hfile at hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230211/family1/0ac359c0608d440092b65fe62b8af434 for inclusion in 1b36fb7c48b67f7a86dd4a8ca5d25e59/family1 2023-02-11 19:56:32,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-11 19:56:32,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(777): Region bounds: first= last=1 2023-02-11 19:56:32,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegion(2445): Flush status journal for 1b36fb7c48b67f7a86dd4a8ca5d25e59: 2023-02-11 19:56:32,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230211/family1/0ac359c0608d440092b65fe62b8af434 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionFromAdmin__e2pnrdfmeci93tvmp4fmgdtj83tu2ort6811s442bo1ndko3mremmck903l6d9df/family1/0ac359c0608d440092b65fe62b8af434 2023-02-11 19:56:32,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionFromAdmin__e2pnrdfmeci93tvmp4fmgdtj83tu2ort6811s442bo1ndko3mremmck903l6d9df/family1/0ac359c0608d440092b65fe62b8af434 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/d366b2feea2844c0bf878422a4996fa6_SeqId_28_ 2023-02-11 19:56:32,216 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(849): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionFromAdmin__e2pnrdfmeci93tvmp4fmgdtj83tu2ort6811s442bo1ndko3mremmck903l6d9df/family1/0ac359c0608d440092b65fe62b8af434 into 1b36fb7c48b67f7a86dd4a8ca5d25e59/family1 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/d366b2feea2844c0bf878422a4996fa6_SeqId_28_ - updating store file list. 2023-02-11 19:56:32,237 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(882): Loaded HFile hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/d366b2feea2844c0bf878422a4996fa6_SeqId_28_ into 1b36fb7c48b67f7a86dd4a8ca5d25e59/family1 2023-02-11 19:56:32,237 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.HStore(855): Successfully loaded hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionFromAdmin__e2pnrdfmeci93tvmp4fmgdtj83tu2ort6811s442bo1ndko3mremmck903l6d9df/family1/0ac359c0608d440092b65fe62b8af434 into 1b36fb7c48b67f7a86dd4a8ca5d25e59/family1 (new location: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/family1/d366b2feea2844c0bf878422a4996fa6_SeqId_28_) 2023-02-11 19:56:32,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45897] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/staging/jenkins__testMajorCompactionFromAdmin__e2pnrdfmeci93tvmp4fmgdtj83tu2ort6811s442bo1ndko3mremmck903l6d9df/family1/0ac359c0608d440092b65fe62b8af434 2023-02-11 19:56:32,239 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 19:56:32,240 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:56:32,241 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302112fe944cbd58744e69c6ba88d684f9de2 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302112fe944cbd58744e69c6ba88d684f9de2 2023-02-11 19:56:32,242 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302114e23927014954a7796f5dd0e7fb668a2 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302114e23927014954a7796f5dd0e7fb668a2 2023-02-11 19:56:32,242 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302116681ebe3efff42619aa0a3d36957537b to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302116681ebe3efff42619aa0a3d36957537b 2023-02-11 19:56:32,243 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230211f031b50799664a70b62a2e83a16f9122 to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230211f031b50799664a70b62a2e83a16f9122 2023-02-11 19:56:32,243 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-11 19:56:32,243 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230211' 2023-02-11 19:56:32,243 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230211 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-11 19:56:32,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 19:56:32,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-11 19:56:32,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(367): [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302111162074b98624f50bc4b7f509a121684_del] 2023-02-11 19:56:32,244 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:56:32,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302111162074b98624f50bc4b7f509a121684_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302111162074b98624f50bc4b7f509a121684_del 2023-02-11 19:56:32,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-11 19:56:32,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(367): [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021122885660d4d24ad69b38164c8604e3ff_del] 2023-02-11 19:56:32,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:56:32,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021122885660d4d24ad69b38164c8604e3ff_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021122885660d4d24ad69b38164c8604e3ff_del 2023-02-11 19:56:32,246 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-11 19:56:32,246 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] compactions.PartitionedMobCompactor(367): [hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021184cd37017a35429cb7a0390a7b4306d8_del] 2023-02-11 19:56:32,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 19:56:32,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021184cd37017a35429cb7a0390a7b4306d8_del to hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021184cd37017a35429cb7a0390a7b4306d8_del 2023-02-11 19:56:32,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-11 19:56:32,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676145220037] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 19:56:32,249 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-11 19:56:32,250 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.7810 sec 2023-02-11 19:56:32,264 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 19:56:32,266 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 19:56:32,268 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 19:56:32,269 DEBUG [Listener at localhost/32929] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 19:56:32,273 INFO [Listener at localhost/32929] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:56:32,307 INFO [Listener at localhost/32929] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=248 (was 261), OpenFileDescriptor=629 (was 648), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=229 (was 219) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3645 (was 3654) 2023-02-11 19:56:32,307 DEBUG [Listener at localhost/32929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7defec53 to 127.0.0.1:64025 2023-02-11 19:56:32,307 DEBUG [Listener at localhost/32929] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:56:32,308 INFO [Listener at localhost/32929] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 19:56:32,308 INFO [Listener at localhost/32929] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:56:32,308 DEBUG [Listener at localhost/32929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0629018b to 127.0.0.1:64025 2023-02-11 19:56:32,308 DEBUG [Listener at localhost/32929] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:56:32,308 DEBUG [Listener at localhost/32929] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 19:56:32,309 DEBUG [Listener at localhost/32929] util.JVMClusterUtil(257): Found active master hash=232064349, stopped=false 2023-02-11 19:56:32,309 INFO [Listener at localhost/32929] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40445,1676145214633 2023-02-11 19:56:32,310 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 19:56:32,310 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 19:56:32,311 INFO [Listener at localhost/32929] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 19:56:32,311 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:56:32,311 DEBUG [Listener at localhost/32929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x79b13808 to 127.0.0.1:64025 2023-02-11 19:56:32,311 DEBUG [Listener at localhost/32929] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:56:32,311 INFO [Listener at localhost/32929] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45897,1676145215747' ***** 2023-02-11 19:56:32,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:56:32,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:56:32,311 INFO [Listener at localhost/32929] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 19:56:32,312 INFO [RS:0;jenkins-hbase4:45897] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 19:56:32,312 INFO [RS:0;jenkins-hbase4:45897] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 19:56:32,312 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 19:56:32,312 INFO [RS:0;jenkins-hbase4:45897] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 19:56:32,312 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(3304): Received CLOSE for d52518349916d0cbd7809e18f5082b6c 2023-02-11 19:56:32,312 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(3304): Received CLOSE for 02279d174624d22b1025401891d904b4 2023-02-11 19:56:32,312 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(3304): Received CLOSE for 17a611547a606c5d3b8c51f9809db923 2023-02-11 19:56:32,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d52518349916d0cbd7809e18f5082b6c, disabling compactions & flushes 2023-02-11 19:56:32,312 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(3304): Received CLOSE for e850bceb7d66bdd1c5950a043e7e6c3e 2023-02-11 19:56:32,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:56:32,312 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(3304): Received CLOSE for 3b84089ed749a7da100e5f757b3cd2dc 2023-02-11 19:56:32,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:56:32,312 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(3304): Received CLOSE for c5d7f471612198bab87fbe1b067a8ab0 2023-02-11 19:56:32,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. after waiting 0 ms 2023-02-11 19:56:32,313 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(3304): Received CLOSE for 9e0c530d5d033c122144679ce520b6e5 2023-02-11 19:56:32,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:56:32,313 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(3304): Received CLOSE for 7fade4c8a6079ee1828f4aac4df78b5e 2023-02-11 19:56:32,313 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(3304): Received CLOSE for 91920e03fd524f4120fe99584949959d 2023-02-11 19:56:32,313 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(3304): Received CLOSE for 6812f076b430f985f8f3eb44f6e4404b 2023-02-11 19:56:32,313 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(3304): Received CLOSE for 22951ff8096602d1969aa6daaf2e1413 2023-02-11 19:56:32,313 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(3304): Received CLOSE for c4cc5915c5085f6b3ca4eeb5d49aac69 2023-02-11 19:56:32,313 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(3304): Received CLOSE for 42f2c6a1e29ae18303d02e7977b355c5 2023-02-11 19:56:32,313 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(3304): Received CLOSE for 0086a9a022be72d7afa868235730b454 2023-02-11 19:56:32,313 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(3304): Received CLOSE for 1b36fb7c48b67f7a86dd4a8ca5d25e59 2023-02-11 19:56:32,313 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(3304): Received CLOSE for 4d3bfd92285822c834526e098976e53c 2023-02-11 19:56:32,313 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(3304): Received CLOSE for 43d4d223fc2e23c806b3e24d0b9e14e7 2023-02-11 19:56:32,313 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(3304): Received CLOSE for 41e9cd5e0c2aceca461c1cf15a182b3c 2023-02-11 19:56:32,313 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(3304): Received CLOSE for 80bcde05173896e6ceb86130796e3c57 2023-02-11 19:56:32,313 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(3304): Received CLOSE for 69b2602d8eb42fd8a253bad1a4ec74ea 2023-02-11 19:56:32,313 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:32,313 DEBUG [RS:0;jenkins-hbase4:45897] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57cb832b to 127.0.0.1:64025 2023-02-11 19:56:32,313 DEBUG [RS:0;jenkins-hbase4:45897] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:56:32,314 INFO [RS:0;jenkins-hbase4:45897] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 19:56:32,314 INFO [RS:0;jenkins-hbase4:45897] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 19:56:32,314 INFO [RS:0;jenkins-hbase4:45897] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 19:56:32,314 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 19:56:32,314 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-02-11 19:56:32,314 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 19:56:32,314 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 19:56:32,314 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 19:56:32,315 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 19:56:32,315 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 19:56:32,315 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-02-11 19:56:32,315 DEBUG [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(1505): Waiting on 0086a9a022be72d7afa868235730b454, 02279d174624d22b1025401891d904b4, 1588230740, 17a611547a606c5d3b8c51f9809db923, 1b36fb7c48b67f7a86dd4a8ca5d25e59, 22951ff8096602d1969aa6daaf2e1413, 3b84089ed749a7da100e5f757b3cd2dc, 41e9cd5e0c2aceca461c1cf15a182b3c, 42f2c6a1e29ae18303d02e7977b355c5, 43d4d223fc2e23c806b3e24d0b9e14e7, 4d3bfd92285822c834526e098976e53c, 6812f076b430f985f8f3eb44f6e4404b, 69b2602d8eb42fd8a253bad1a4ec74ea, 7fade4c8a6079ee1828f4aac4df78b5e, 80bcde05173896e6ceb86130796e3c57, 91920e03fd524f4120fe99584949959d, 9e0c530d5d033c122144679ce520b6e5, c4cc5915c5085f6b3ca4eeb5d49aac69, c5d7f471612198bab87fbe1b067a8ab0, d52518349916d0cbd7809e18f5082b6c, e850bceb7d66bdd1c5950a043e7e6c3e 2023-02-11 19:56:32,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/d52518349916d0cbd7809e18f5082b6c/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-11 19:56:32,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:56:32,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d52518349916d0cbd7809e18f5082b6c: Waiting for close lock at 1676145392312Running coprocessor pre-close hooks at 1676145392312Disabling compacts and flushes for region at 1676145392312Disabling writes for close at 1676145392313 (+1 ms)Writing region close event to WAL at 1676145392313Running coprocessor post-close hooks at 1676145392317 (+4 ms)Closed at 1676145392318 (+1 ms) 2023-02-11 19:56:32,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676145220180.d52518349916d0cbd7809e18f5082b6c. 2023-02-11 19:56:32,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 02279d174624d22b1025401891d904b4, disabling compactions & flushes 2023-02-11 19:56:32,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:32,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:32,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. after waiting 0 ms 2023-02-11 19:56:32,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:32,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithMonthlyPolicy/02279d174624d22b1025401891d904b4/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-11 19:56:32,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:32,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 02279d174624d22b1025401891d904b4: Waiting for close lock at 1676145392318Running coprocessor pre-close hooks at 1676145392318Disabling compacts and flushes for region at 1676145392318Disabling writes for close at 1676145392318Writing region close event to WAL at 1676145392319 (+1 ms)Running coprocessor post-close hooks at 1676145392323 (+4 ms)Closed at 1676145392324 (+1 ms) 2023-02-11 19:56:32,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1676145362429.02279d174624d22b1025401891d904b4. 2023-02-11 19:56:32,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 17a611547a606c5d3b8c51f9809db923, disabling compactions & flushes 2023-02-11 19:56:32,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923. 2023-02-11 19:56:32,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923. 2023-02-11 19:56:32,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923. after waiting 0 ms 2023-02-11 19:56:32,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923. 2023-02-11 19:56:32,325 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740/.tmp/info/c35f8acc497c422595cda152a2dccea0 2023-02-11 19:56:32,326 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-11 19:56:32,326 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-11 19:56:32,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/17a611547a606c5d3b8c51f9809db923/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 19:56:32,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923. 2023-02-11 19:56:32,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 17a611547a606c5d3b8c51f9809db923: Waiting for close lock at 1676145392324Running coprocessor pre-close hooks at 1676145392324Disabling compacts and flushes for region at 1676145392324Disabling writes for close at 1676145392325 (+1 ms)Writing region close event to WAL at 1676145392325Running coprocessor post-close hooks at 1676145392328 (+3 ms)Closed at 1676145392328 2023-02-11 19:56:32,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1676145260880.17a611547a606c5d3b8c51f9809db923. 2023-02-11 19:56:32,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e850bceb7d66bdd1c5950a043e7e6c3e, disabling compactions & flushes 2023-02-11 19:56:32,329 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c35f8acc497c422595cda152a2dccea0 2023-02-11 19:56:32,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e. 2023-02-11 19:56:32,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e. 2023-02-11 19:56:32,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e. after waiting 0 ms 2023-02-11 19:56:32,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e. 2023-02-11 19:56:32,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing e850bceb7d66bdd1c5950a043e7e6c3e 1/1 column families, dataSize=109 B heapSize=592 B 2023-02-11 19:56:32,333 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-02-11 19:56:32,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/namespace/e850bceb7d66bdd1c5950a043e7e6c3e/.tmp/info/f5052a978900403685dadd3d4fa2ad72 2023-02-11 19:56:32,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/namespace/e850bceb7d66bdd1c5950a043e7e6c3e/.tmp/info/f5052a978900403685dadd3d4fa2ad72 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/namespace/e850bceb7d66bdd1c5950a043e7e6c3e/info/f5052a978900403685dadd3d4fa2ad72 2023-02-11 19:56:32,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/namespace/e850bceb7d66bdd1c5950a043e7e6c3e/info/f5052a978900403685dadd3d4fa2ad72, entries=3, sequenceid=7, filesize=4.8 K 2023-02-11 19:56:32,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for e850bceb7d66bdd1c5950a043e7e6c3e in 13ms, sequenceid=7, compaction requested=false 2023-02-11 19:56:32,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/namespace/e850bceb7d66bdd1c5950a043e7e6c3e/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-02-11 19:56:32,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e. 2023-02-11 19:56:32,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e850bceb7d66bdd1c5950a043e7e6c3e: Waiting for close lock at 1676145392329Running coprocessor pre-close hooks at 1676145392329Disabling compacts and flushes for region at 1676145392329Disabling writes for close at 1676145392329Obtaining lock to block concurrent updates at 1676145392329Preparing flush snapshotting stores in e850bceb7d66bdd1c5950a043e7e6c3e at 1676145392329Finished memstore snapshotting hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e., syncing WAL and waiting on mvcc, flushsize=dataSize=109, getHeapSize=576, getOffHeapSize=0, getCellsCount=3 at 1676145392329Flushing stores of hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e. at 1676145392329Flushing e850bceb7d66bdd1c5950a043e7e6c3e/info: creating writer at 1676145392329Flushing e850bceb7d66bdd1c5950a043e7e6c3e/info: appending metadata at 1676145392331 (+2 ms)Flushing e850bceb7d66bdd1c5950a043e7e6c3e/info: closing flushed file at 1676145392331Flushing e850bceb7d66bdd1c5950a043e7e6c3e/info: reopening flushed file at 1676145392338 (+7 ms)Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for e850bceb7d66bdd1c5950a043e7e6c3e in 13ms, sequenceid=7, compaction requested=false at 1676145392342 (+4 ms)Writing region close event to WAL at 1676145392343 (+1 ms)Running coprocessor post-close hooks at 1676145392346 (+3 ms)Closed at 1676145392346 2023-02-11 19:56:32,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676145218620.e850bceb7d66bdd1c5950a043e7e6c3e. 2023-02-11 19:56:32,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3b84089ed749a7da100e5f757b3cd2dc, disabling compactions & flushes 2023-02-11 19:56:32,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:56:32,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:56:32,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. after waiting 0 ms 2023-02-11 19:56:32,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:56:32,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyPolicy/3b84089ed749a7da100e5f757b3cd2dc/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-11 19:56:32,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:56:32,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3b84089ed749a7da100e5f757b3cd2dc: Waiting for close lock at 1676145392347Running coprocessor pre-close hooks at 1676145392347Disabling compacts and flushes for region at 1676145392347Disabling writes for close at 1676145392347Writing region close event to WAL at 1676145392347Running coprocessor post-close hooks at 1676145392350 (+3 ms)Closed at 1676145392350 2023-02-11 19:56:32,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1676145265488.3b84089ed749a7da100e5f757b3cd2dc. 2023-02-11 19:56:32,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c5d7f471612198bab87fbe1b067a8ab0, disabling compactions & flushes 2023-02-11 19:56:32,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:56:32,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:56:32,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. after waiting 0 ms 2023-02-11 19:56:32,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:56:32,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c5d7f471612198bab87fbe1b067a8ab0/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-11 19:56:32,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:56:32,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c5d7f471612198bab87fbe1b067a8ab0: Waiting for close lock at 1676145392350Running coprocessor pre-close hooks at 1676145392350Disabling compacts and flushes for region at 1676145392350Disabling writes for close at 1676145392351 (+1 ms)Writing region close event to WAL at 1676145392351Running coprocessor post-close hooks at 1676145392353 (+2 ms)Closed at 1676145392354 (+1 ms) 2023-02-11 19:56:32,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676145278748.c5d7f471612198bab87fbe1b067a8ab0. 2023-02-11 19:56:32,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9e0c530d5d033c122144679ce520b6e5, disabling compactions & flushes 2023-02-11 19:56:32,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5. 2023-02-11 19:56:32,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5. 2023-02-11 19:56:32,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5. after waiting 0 ms 2023-02-11 19:56:32,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5. 2023-02-11 19:56:32,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/9e0c530d5d033c122144679ce520b6e5/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 19:56:32,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5. 2023-02-11 19:56:32,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9e0c530d5d033c122144679ce520b6e5: Waiting for close lock at 1676145392354Running coprocessor pre-close hooks at 1676145392354Disabling compacts and flushes for region at 1676145392354Disabling writes for close at 1676145392354Writing region close event to WAL at 1676145392354Running coprocessor post-close hooks at 1676145392357 (+3 ms)Closed at 1676145392357 2023-02-11 19:56:32,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1676145260880.9e0c530d5d033c122144679ce520b6e5. 2023-02-11 19:56:32,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7fade4c8a6079ee1828f4aac4df78b5e, disabling compactions & flushes 2023-02-11 19:56:32,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:32,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:32,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. after waiting 0 ms 2023-02-11 19:56:32,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:32,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/7fade4c8a6079ee1828f4aac4df78b5e/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-11 19:56:32,361 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:32,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7fade4c8a6079ee1828f4aac4df78b5e: Waiting for close lock at 1676145392357Running coprocessor pre-close hooks at 1676145392357Disabling compacts and flushes for region at 1676145392357Disabling writes for close at 1676145392357Writing region close event to WAL at 1676145392358 (+1 ms)Running coprocessor post-close hooks at 1676145392360 (+2 ms)Closed at 1676145392361 (+1 ms) 2023-02-11 19:56:32,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1676145373542.7fade4c8a6079ee1828f4aac4df78b5e. 2023-02-11 19:56:32,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 91920e03fd524f4120fe99584949959d, disabling compactions & flushes 2023-02-11 19:56:32,361 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d. 2023-02-11 19:56:32,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d. 2023-02-11 19:56:32,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d. after waiting 0 ms 2023-02-11 19:56:32,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d. 2023-02-11 19:56:32,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testScannerOnBulkLoadRefHFiles/91920e03fd524f4120fe99584949959d/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-11 19:56:32,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d. 2023-02-11 19:56:32,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 91920e03fd524f4120fe99584949959d: Waiting for close lock at 1676145392361Running coprocessor pre-close hooks at 1676145392361Disabling compacts and flushes for region at 1676145392361Disabling writes for close at 1676145392361Writing region close event to WAL at 1676145392361Running coprocessor post-close hooks at 1676145392363 (+2 ms)Closed at 1676145392364 (+1 ms) 2023-02-11 19:56:32,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1676145260880.91920e03fd524f4120fe99584949959d. 2023-02-11 19:56:32,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6812f076b430f985f8f3eb44f6e4404b, disabling compactions & flushes 2023-02-11 19:56:32,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:56:32,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:56:32,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. after waiting 0 ms 2023-02-11 19:56:32,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:56:32,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/6812f076b430f985f8f3eb44f6e4404b/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-11 19:56:32,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:56:32,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6812f076b430f985f8f3eb44f6e4404b: Waiting for close lock at 1676145392364Running coprocessor pre-close hooks at 1676145392364Disabling compacts and flushes for region at 1676145392364Disabling writes for close at 1676145392364Writing region close event to WAL at 1676145392365 (+1 ms)Running coprocessor post-close hooks at 1676145392367 (+2 ms)Closed at 1676145392368 (+1 ms) 2023-02-11 19:56:32,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1676145345122.6812f076b430f985f8f3eb44f6e4404b. 2023-02-11 19:56:32,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 22951ff8096602d1969aa6daaf2e1413, disabling compactions & flushes 2023-02-11 19:56:32,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:56:32,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:56:32,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. after waiting 0 ms 2023-02-11 19:56:32,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:56:32,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMinorCompactionWithWeeklyPolicy/22951ff8096602d1969aa6daaf2e1413/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-11 19:56:32,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:56:32,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 22951ff8096602d1969aa6daaf2e1413: Waiting for close lock at 1676145392368Running coprocessor pre-close hooks at 1676145392368Disabling compacts and flushes for region at 1676145392368Disabling writes for close at 1676145392368Writing region close event to WAL at 1676145392369 (+1 ms)Running coprocessor post-close hooks at 1676145392371 (+2 ms)Closed at 1676145392371 2023-02-11 19:56:32,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1676145248553.22951ff8096602d1969aa6daaf2e1413. 2023-02-11 19:56:32,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c4cc5915c5085f6b3ca4eeb5d49aac69, disabling compactions & flushes 2023-02-11 19:56:32,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:32,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:32,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. after waiting 0 ms 2023-02-11 19:56:32,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:32,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/c4cc5915c5085f6b3ca4eeb5d49aac69/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-11 19:56:32,376 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:32,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c4cc5915c5085f6b3ca4eeb5d49aac69: Waiting for close lock at 1676145392371Running coprocessor pre-close hooks at 1676145392371Disabling compacts and flushes for region at 1676145392371Disabling writes for close at 1676145392371Writing region close event to WAL at 1676145392373 (+2 ms)Running coprocessor post-close hooks at 1676145392375 (+2 ms)Closed at 1676145392376 (+1 ms) 2023-02-11 19:56:32,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1676145373542.c4cc5915c5085f6b3ca4eeb5d49aac69. 2023-02-11 19:56:32,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 42f2c6a1e29ae18303d02e7977b355c5, disabling compactions & flushes 2023-02-11 19:56:32,376 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:56:32,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:56:32,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. after waiting 0 ms 2023-02-11 19:56:32,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:56:32,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/42f2c6a1e29ae18303d02e7977b355c5/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-11 19:56:32,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:56:32,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 42f2c6a1e29ae18303d02e7977b355c5: Waiting for close lock at 1676145392376Running coprocessor pre-close hooks at 1676145392376Disabling compacts and flushes for region at 1676145392376Disabling writes for close at 1676145392376Writing region close event to WAL at 1676145392377 (+1 ms)Running coprocessor post-close hooks at 1676145392379 (+2 ms)Closed at 1676145392380 (+1 ms) 2023-02-11 19:56:32,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1676145317351.42f2c6a1e29ae18303d02e7977b355c5. 2023-02-11 19:56:32,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0086a9a022be72d7afa868235730b454, disabling compactions & flushes 2023-02-11 19:56:32,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:56:32,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:56:32,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. after waiting 0 ms 2023-02-11 19:56:32,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:56:32,383 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:56:32,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/0086a9a022be72d7afa868235730b454/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-11 19:56:32,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:56:32,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0086a9a022be72d7afa868235730b454: Waiting for close lock at 1676145392381Running coprocessor pre-close hooks at 1676145392381Disabling compacts and flushes for region at 1676145392381Disabling writes for close at 1676145392381Writing region close event to WAL at 1676145392382 (+1 ms)Running coprocessor post-close hooks at 1676145392384 (+2 ms)Closed at 1676145392384 2023-02-11 19:56:32,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1676145317351.0086a9a022be72d7afa868235730b454. 2023-02-11 19:56:32,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1b36fb7c48b67f7a86dd4a8ca5d25e59, disabling compactions & flushes 2023-02-11 19:56:32,385 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:32,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:32,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. after waiting 0 ms 2023-02-11 19:56:32,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:32,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionFromAdmin/1b36fb7c48b67f7a86dd4a8ca5d25e59/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-11 19:56:32,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:32,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1b36fb7c48b67f7a86dd4a8ca5d25e59: Waiting for close lock at 1676145392385Running coprocessor pre-close hooks at 1676145392385Disabling compacts and flushes for region at 1676145392385Disabling writes for close at 1676145392385Writing region close event to WAL at 1676145392386 (+1 ms)Running coprocessor post-close hooks at 1676145392388 (+2 ms)Closed at 1676145392388 2023-02-11 19:56:32,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1676145373542.1b36fb7c48b67f7a86dd4a8ca5d25e59. 2023-02-11 19:56:32,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4d3bfd92285822c834526e098976e53c, disabling compactions & flushes 2023-02-11 19:56:32,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:56:32,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:56:32,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. after waiting 0 ms 2023-02-11 19:56:32,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:56:32,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/4d3bfd92285822c834526e098976e53c/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-11 19:56:32,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:56:32,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4d3bfd92285822c834526e098976e53c: Waiting for close lock at 1676145392389Running coprocessor pre-close hooks at 1676145392389Disabling compacts and flushes for region at 1676145392389Disabling writes for close at 1676145392389Writing region close event to WAL at 1676145392390 (+1 ms)Running coprocessor post-close hooks at 1676145392392 (+2 ms)Closed at 1676145392392 2023-02-11 19:56:32,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1676145345122.4d3bfd92285822c834526e098976e53c. 2023-02-11 19:56:32,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 43d4d223fc2e23c806b3e24d0b9e14e7, disabling compactions & flushes 2023-02-11 19:56:32,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:56:32,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:56:32,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. after waiting 0 ms 2023-02-11 19:56:32,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:56:32,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/43d4d223fc2e23c806b3e24d0b9e14e7/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-11 19:56:32,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:56:32,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 43d4d223fc2e23c806b3e24d0b9e14e7: Waiting for close lock at 1676145392392Running coprocessor pre-close hooks at 1676145392392Disabling compacts and flushes for region at 1676145392392Disabling writes for close at 1676145392392Writing region close event to WAL at 1676145392393 (+1 ms)Running coprocessor post-close hooks at 1676145392395 (+2 ms)Closed at 1676145392395 2023-02-11 19:56:32,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676145295370.43d4d223fc2e23c806b3e24d0b9e14e7. 2023-02-11 19:56:32,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 41e9cd5e0c2aceca461c1cf15a182b3c, disabling compactions & flushes 2023-02-11 19:56:32,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:56:32,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:56:32,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. after waiting 0 ms 2023-02-11 19:56:32,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:56:32,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testCompactionWithHFileLink/41e9cd5e0c2aceca461c1cf15a182b3c/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-11 19:56:32,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:56:32,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 41e9cd5e0c2aceca461c1cf15a182b3c: Waiting for close lock at 1676145392395Running coprocessor pre-close hooks at 1676145392395Disabling compacts and flushes for region at 1676145392395Disabling writes for close at 1676145392395Writing region close event to WAL at 1676145392396 (+1 ms)Running coprocessor post-close hooks at 1676145392398 (+2 ms)Closed at 1676145392398 2023-02-11 19:56:32,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1676145317351.41e9cd5e0c2aceca461c1cf15a182b3c. 2023-02-11 19:56:32,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 80bcde05173896e6ceb86130796e3c57, disabling compactions & flushes 2023-02-11 19:56:32,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:56:32,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:56:32,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. after waiting 0 ms 2023-02-11 19:56:32,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:56:32,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/ns/testMinorCompaction/80bcde05173896e6ceb86130796e3c57/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-11 19:56:32,401 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:56:32,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 80bcde05173896e6ceb86130796e3c57: Waiting for close lock at 1676145392398Running coprocessor pre-close hooks at 1676145392398Disabling compacts and flushes for region at 1676145392398Disabling writes for close at 1676145392398Writing region close event to WAL at 1676145392399 (+1 ms)Running coprocessor post-close hooks at 1676145392401 (+2 ms)Closed at 1676145392401 2023-02-11 19:56:32,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1676145345122.80bcde05173896e6ceb86130796e3c57. 2023-02-11 19:56:32,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 69b2602d8eb42fd8a253bad1a4ec74ea, disabling compactions & flushes 2023-02-11 19:56:32,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:56:32,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:56:32,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. after waiting 0 ms 2023-02-11 19:56:32,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:56:32,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/default/testMajorCompactionWithMonthlyPolicy/69b2602d8eb42fd8a253bad1a4ec74ea/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-11 19:56:32,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:56:32,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 69b2602d8eb42fd8a253bad1a4ec74ea: Waiting for close lock at 1676145392401Running coprocessor pre-close hooks at 1676145392401Disabling compacts and flushes for region at 1676145392401Disabling writes for close at 1676145392402 (+1 ms)Writing region close event to WAL at 1676145392402Running coprocessor post-close hooks at 1676145392404 (+2 ms)Closed at 1676145392404 2023-02-11 19:56:32,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1676145236909.69b2602d8eb42fd8a253bad1a4ec74ea. 2023-02-11 19:56:32,515 DEBUG [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 19:56:32,716 DEBUG [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 19:56:32,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740/.tmp/rep_barrier/14a1315a68d949e5a8a8d4936321cb43 2023-02-11 19:56:32,738 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14a1315a68d949e5a8a8d4936321cb43 2023-02-11 19:56:32,916 DEBUG [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 19:56:33,116 DEBUG [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 19:56:33,144 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740/.tmp/table/312eb885e3204595a1e40234a826bd36 2023-02-11 19:56:33,147 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 312eb885e3204595a1e40234a826bd36 2023-02-11 19:56:33,148 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740/.tmp/info/c35f8acc497c422595cda152a2dccea0 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740/info/c35f8acc497c422595cda152a2dccea0 2023-02-11 19:56:33,152 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c35f8acc497c422595cda152a2dccea0 2023-02-11 19:56:33,152 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740/info/c35f8acc497c422595cda152a2dccea0, entries=226, sequenceid=130, filesize=37.9 K 2023-02-11 19:56:33,153 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740/.tmp/rep_barrier/14a1315a68d949e5a8a8d4936321cb43 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740/rep_barrier/14a1315a68d949e5a8a8d4936321cb43 2023-02-11 19:56:33,156 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14a1315a68d949e5a8a8d4936321cb43 2023-02-11 19:56:33,157 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740/rep_barrier/14a1315a68d949e5a8a8d4936321cb43, entries=1, sequenceid=130, filesize=5.0 K 2023-02-11 19:56:33,157 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740/.tmp/table/312eb885e3204595a1e40234a826bd36 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740/table/312eb885e3204595a1e40234a826bd36 2023-02-11 19:56:33,161 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 312eb885e3204595a1e40234a826bd36 2023-02-11 19:56:33,161 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740/table/312eb885e3204595a1e40234a826bd36, entries=27, sequenceid=130, filesize=6.6 K 2023-02-11 19:56:33,163 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 848ms, sequenceid=130, compaction requested=false 2023-02-11 19:56:33,166 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-02-11 19:56:33,167 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 19:56:33,167 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 19:56:33,167 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676145392314Running coprocessor pre-close hooks at 1676145392314Disabling compacts and flushes for region at 1676145392314Disabling writes for close at 1676145392315 (+1 ms)Obtaining lock to block concurrent updates at 1676145392315Preparing flush snapshotting stores in 1588230740 at 1676145392315Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=51772, getHeapSize=80064, getOffHeapSize=0, getCellsCount=365 at 1676145392315Flushing stores of hbase:meta,,1.1588230740 at 1676145392315Flushing 1588230740/info: creating writer at 1676145392315Flushing 1588230740/info: appending metadata at 1676145392319 (+4 ms)Flushing 1588230740/info: closing flushed file at 1676145392319Flushing 1588230740/rep_barrier: creating writer at 1676145392329 (+10 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676145392330 (+1 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676145392330Flushing 1588230740/table: creating writer at 1676145392738 (+408 ms)Flushing 1588230740/table: appending metadata at 1676145392740 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676145392740Flushing 1588230740/info: reopening flushed file at 1676145393149 (+409 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676145393153 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676145393157 (+4 ms)Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 848ms, sequenceid=130, compaction requested=false at 1676145393163 (+6 ms)Writing region close event to WAL at 1676145393164 (+1 ms)Running coprocessor post-close hooks at 1676145393167 (+3 ms)Closed at 1676145393167 2023-02-11 19:56:33,167 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 19:56:33,316 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45897,1676145215747; all regions closed. 2023-02-11 19:56:33,323 DEBUG [RS:0;jenkins-hbase4:45897] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/oldWALs 2023-02-11 19:56:33,323 INFO [RS:0;jenkins-hbase4:45897] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45897%2C1676145215747.meta:.meta(num 1676145218386) 2023-02-11 19:56:33,327 DEBUG [RS:0;jenkins-hbase4:45897] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/oldWALs 2023-02-11 19:56:33,327 INFO [RS:0;jenkins-hbase4:45897] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45897%2C1676145215747:(num 1676145217471) 2023-02-11 19:56:33,327 DEBUG [RS:0;jenkins-hbase4:45897] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:56:33,327 INFO [RS:0;jenkins-hbase4:45897] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:56:33,328 INFO [RS:0;jenkins-hbase4:45897] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 19:56:33,328 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 19:56:33,329 INFO [RS:0;jenkins-hbase4:45897] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45897 2023-02-11 19:56:33,337 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45897,1676145215747 2023-02-11 19:56:33,337 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:56:33,337 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:56:33,337 ERROR [Listener at localhost/32929-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@494a63d9 rejected from java.util.concurrent.ThreadPoolExecutor@4d75fe28[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 533] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:56:33,338 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45897,1676145215747] 2023-02-11 19:56:33,339 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45897,1676145215747; numProcessing=1 2023-02-11 19:56:33,340 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45897,1676145215747 already deleted, retry=false 2023-02-11 19:56:33,340 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45897,1676145215747 expired; onlineServers=0 2023-02-11 19:56:33,340 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40445,1676145214633' ***** 2023-02-11 19:56:33,340 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 19:56:33,341 DEBUG [M:0;jenkins-hbase4:40445] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ce80f66, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 19:56:33,341 INFO [M:0;jenkins-hbase4:40445] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40445,1676145214633 2023-02-11 19:56:33,341 INFO [M:0;jenkins-hbase4:40445] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40445,1676145214633; all regions closed. 2023-02-11 19:56:33,341 DEBUG [M:0;jenkins-hbase4:40445] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:56:33,341 DEBUG [M:0;jenkins-hbase4:40445] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 19:56:33,341 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 19:56:33,341 DEBUG [M:0;jenkins-hbase4:40445] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 19:56:33,341 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676145217135] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676145217135,5,FailOnTimeoutGroup] 2023-02-11 19:56:33,341 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676145217135] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676145217135,5,FailOnTimeoutGroup] 2023-02-11 19:56:33,341 INFO [M:0;jenkins-hbase4:40445] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 19:56:33,341 INFO [M:0;jenkins-hbase4:40445] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 19:56:33,341 INFO [M:0;jenkins-hbase4:40445] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-11 19:56:33,342 DEBUG [M:0;jenkins-hbase4:40445] master.HMaster(1502): Stopping service threads 2023-02-11 19:56:33,342 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 19:56:33,342 INFO [M:0;jenkins-hbase4:40445] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 19:56:33,342 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:56:33,342 ERROR [M:0;jenkins-hbase4:40445] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] 2023-02-11 19:56:33,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-02-11 19:56:33,343 INFO [M:0;jenkins-hbase4:40445] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 19:56:33,343 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 19:56:33,344 DEBUG [M:0;jenkins-hbase4:40445] zookeeper.ZKUtil(398): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-11 19:56:33,344 WARN [M:0;jenkins-hbase4:40445] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-11 19:56:33,344 INFO [M:0;jenkins-hbase4:40445] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 19:56:33,344 INFO [M:0;jenkins-hbase4:40445] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 19:56:33,344 DEBUG [M:0;jenkins-hbase4:40445] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 19:56:33,344 INFO [M:0;jenkins-hbase4:40445] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:56:33,344 DEBUG [M:0;jenkins-hbase4:40445] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:56:33,344 DEBUG [M:0;jenkins-hbase4:40445] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 19:56:33,344 DEBUG [M:0;jenkins-hbase4:40445] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:56:33,344 INFO [M:0;jenkins-hbase4:40445] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.79 KB heapSize=598.54 KB 2023-02-11 19:56:33,439 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:56:33,439 INFO [RS:0;jenkins-hbase4:45897] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45897,1676145215747; zookeeper connection closed. 2023-02-11 19:56:33,439 ERROR [Listener at localhost/32929-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@237b0ae1 rejected from java.util.concurrent.ThreadPoolExecutor@4d75fe28[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 533] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:56:33,439 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): regionserver:45897-0x10044f22b400001, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:56:33,439 ERROR [Listener at localhost/32929-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5b53dc5c rejected from java.util.concurrent.ThreadPoolExecutor@4d75fe28[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 533] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:56:33,439 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@611f7d2d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@611f7d2d 2023-02-11 19:56:33,439 INFO [Listener at localhost/32929] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-02-11 19:56:33,752 INFO [M:0;jenkins-hbase4:40445] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.79 KB at sequenceid=1005 (bloomFilter=true), to=hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/96f724fc35ce4e9a9b85b8e373a03054 2023-02-11 19:56:33,755 INFO [M:0;jenkins-hbase4:40445] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 96f724fc35ce4e9a9b85b8e373a03054 2023-02-11 19:56:33,756 DEBUG [M:0;jenkins-hbase4:40445] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/96f724fc35ce4e9a9b85b8e373a03054 as hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/96f724fc35ce4e9a9b85b8e373a03054 2023-02-11 19:56:33,759 INFO [M:0;jenkins-hbase4:40445] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 96f724fc35ce4e9a9b85b8e373a03054 2023-02-11 19:56:33,759 INFO [M:0;jenkins-hbase4:40445] regionserver.HStore(1080): Added hdfs://localhost:43109/user/jenkins/test-data/dd9bc937-74a2-010c-6b2e-06c6c1c359da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/96f724fc35ce4e9a9b85b8e373a03054, entries=123, sequenceid=1005, filesize=33.3 K 2023-02-11 19:56:33,759 INFO [M:0;jenkins-hbase4:40445] regionserver.HRegion(2947): Finished flush of dataSize ~512.79 KB/525092, heapSize ~598.52 KB/612888, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 415ms, sequenceid=1005, compaction requested=false 2023-02-11 19:56:33,760 INFO [M:0;jenkins-hbase4:40445] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:56:33,760 DEBUG [M:0;jenkins-hbase4:40445] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676145393344Disabling compacts and flushes for region at 1676145393344Disabling writes for close at 1676145393344Obtaining lock to block concurrent updates at 1676145393344Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676145393344Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=525092, getHeapSize=612888, getOffHeapSize=0, getCellsCount=1160 at 1676145393345 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676145393345Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676145393345Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676145393348 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676145393348Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676145393756 (+408 ms)Finished flush of dataSize ~512.79 KB/525092, heapSize ~598.52 KB/612888, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 415ms, sequenceid=1005, compaction requested=false at 1676145393760 (+4 ms)Writing region close event to WAL at 1676145393760Closed at 1676145393760 2023-02-11 19:56:33,763 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 19:56:33,763 INFO [M:0;jenkins-hbase4:40445] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 19:56:33,764 INFO [M:0;jenkins-hbase4:40445] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40445 2023-02-11 19:56:33,767 DEBUG [M:0;jenkins-hbase4:40445] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40445,1676145214633 already deleted, retry=false 2023-02-11 19:56:33,868 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:56:33,868 INFO [M:0;jenkins-hbase4:40445] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40445,1676145214633; zookeeper connection closed. 2023-02-11 19:56:33,868 ERROR [Listener at localhost/32929-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4bd529f rejected from java.util.concurrent.ThreadPoolExecutor@769cf31e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:56:33,868 DEBUG [Listener at localhost/32929-EventThread] zookeeper.ZKWatcher(600): master:40445-0x10044f22b400000, quorum=127.0.0.1:64025, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:56:33,869 ERROR [Listener at localhost/32929-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@124a0292 rejected from java.util.concurrent.ThreadPoolExecutor@769cf31e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:56:33,870 WARN [Listener at localhost/32929] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 19:56:33,873 INFO [Listener at localhost/32929] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 19:56:33,980 WARN [BP-895779033-172.31.14.131-1676145211569 heartbeating to localhost/127.0.0.1:43109] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 19:56:33,980 WARN [BP-895779033-172.31.14.131-1676145211569 heartbeating to localhost/127.0.0.1:43109] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-895779033-172.31.14.131-1676145211569 (Datanode Uuid 1cd277b8-e4bb-44b5-88a6-20ef0ad23880) service to localhost/127.0.0.1:43109 2023-02-11 19:56:33,982 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/cluster_675f2e08-3f55-fd57-3b4a-b26ff360a207/dfs/data/data1/current/BP-895779033-172.31.14.131-1676145211569] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:56:33,983 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f5a52b67-104b-b9da-5048-dd3084370944/cluster_675f2e08-3f55-fd57-3b4a-b26ff360a207/dfs/data/data2/current/BP-895779033-172.31.14.131-1676145211569] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:56:34,030 INFO [Listener at localhost/32929] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 19:56:34,033 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:56:34,033 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ccea4c9 to 127.0.0.1:64025 2023-02-11 19:56:34,034 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:56:34,165 INFO [Listener at localhost/32929] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 19:56:34,257 INFO [Listener at localhost/32929] hbase.HBaseTestingUtility(1293): Minicluster is down